Jul 21 16:26:18.644393 ip-10-0-135-103 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 16:26:18.644404 ip-10-0-135-103 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 16:26:18.644411 ip-10-0-135-103 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 16:26:18.644653 ip-10-0-135-103 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 16:26:28.860142 ip-10-0-135-103 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 16:26:28.860160 ip-10-0-135-103 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f1e371ad01a74979b7b160050c0a791a --
Jul 21 16:28:19.499773 ip-10-0-135-103 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 16:28:19.841548 ip-10-0-135-103 kubenswrapper[2524]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:28:19.841548 ip-10-0-135-103 kubenswrapper[2524]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 16:28:19.841548 ip-10-0-135-103 kubenswrapper[2524]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:28:19.841548 ip-10-0-135-103 kubenswrapper[2524]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 16:28:19.841548 ip-10-0-135-103 kubenswrapper[2524]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:28:19.844017 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.843956    2524 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 16:28:19.849730 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849717    2524 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:28:19.849730 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849729    2524 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849733    2524 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849736    2524 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849739    2524 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849742    2524 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849745    2524 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849747    2524 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849750    2524 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849753    2524 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849756    2524 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849758    2524 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849767    2524 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849771    2524 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849773    2524 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849776    2524 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849778    2524 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849781    2524 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849783    2524 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849785    2524 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:28:19.849791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849789    2524 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849793    2524 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849796    2524 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849799    2524 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849802    2524 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849805    2524 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849807    2524 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849810    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849813    2524 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849816    2524 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849819    2524 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849821    2524 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849824    2524 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849826    2524 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849828    2524 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849831    2524 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849833    2524 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849836    2524 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849839    2524 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849841    2524 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:28:19.850247 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849844    2524 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849846    2524 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849848    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849850    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849853    2524 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849856    2524 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849858    2524 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849860    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849863    2524 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849865    2524 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849868    2524 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849870    2524 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849872    2524 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849875    2524 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849878    2524 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849881    2524 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849883    2524 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849886    2524 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849889    2524 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849891    2524 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:28:19.850726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849893    2524 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849896    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849898    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849901    2524 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849903    2524 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849905    2524 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849908    2524 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849910    2524 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849912    2524 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849914    2524 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849917    2524 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849919    2524 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849922    2524 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849924    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849926    2524 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849929    2524 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849931    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849934    2524 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849937    2524 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849940    2524 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:28:19.851188 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849942    2524 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849944    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849946    2524 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849949    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849951    2524 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849954    2524 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849957    2524 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849959    2524 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849962    2524 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849964    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849967    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849969    2524 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849971    2524 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849974    2524 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849976    2524 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849980    2524 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849983    2524 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849986    2524 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.849989    2524 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:28:19.851699 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851448    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851456    2524 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851460    2524 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851463    2524 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851467    2524 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851470    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851472    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851475    2524 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851478    2524 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851480    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851483    2524 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851486    2524 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851490    2524 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851492    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851495    2524 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851497    2524 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851499    2524 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851502    2524 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851520    2524 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851523    2524 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:28:19.852133 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851526    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851528    2524 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851531    2524 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851533    2524 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851536    2524 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851538    2524 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851541    2524 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851545    2524 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851548    2524 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851551    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851554    2524 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851556    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851559    2524 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851562    2524 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851565    2524 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851567    2524 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851570    2524 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851573    2524 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851575    2524 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:28:19.852623 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851578    2524 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851580    2524 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851584    2524 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851587    2524 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851591    2524 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851593    2524 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851597    2524 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851599    2524 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851602    2524 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851605    2524 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851607    2524 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851610    2524 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851612    2524 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851615    2524 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851617    2524 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851620    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851623    2524 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851627    2524 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851630    2524 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851634    2524 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:28:19.853066 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851637    2524 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851640    2524 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851643    2524 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851645    2524 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851649    2524 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851652    2524 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851654    2524 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851657    2524 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851659    2524 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851662    2524 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851664    2524 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851666    2524 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851669    2524 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851671    2524 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851674    2524 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851676    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851679    2524 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851681    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851684    2524 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:28:19.853560 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851690    2524 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851705    2524 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851708    2524 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851712    2524 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851715    2524 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851718    2524 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851720    2524 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851723    2524 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851725    2524 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851728    2524 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851730    2524 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851733    2524 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851736    2524 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851738    2524 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851740    2524 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851743    2524 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851746    2524 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851748    2524 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851750    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851753    2524 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:28:19.854004 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.851755    2524 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852079    2524 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852084    2524 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852086    2524 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852090    2524 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852094    2524 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852097    2524 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852099    2524 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852102    2524 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852104    2524 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852107    2524 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852110    2524 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852115    2524 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852118    2524 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852121    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852123    2524 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852126    2524 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852128    2524 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852131    2524 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:28:19.854469 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852133    2524 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852136    2524 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852139    2524 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852142    2524 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852144    2524 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852147    2524 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852149    2524 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852151    2524 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852154    2524 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852156    2524 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852159    2524 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852161    2524 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852164    2524 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852166    2524 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852168    2524 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852171    2524 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852173    2524 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852175    2524 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852179    2524 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852183    2524 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:28:19.854925 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852185    2524 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852189    2524 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852191    2524 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852194    2524 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852197    2524 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852199    2524 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852202    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852205    2524 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852207    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852210    2524 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852212    2524 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852215    2524 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852217    2524 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852220    2524 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852222    2524 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852224    2524 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852227    2524 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852229    2524 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852231    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852234    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:28:19.855396 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852236    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852239    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852241    2524 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852245    2524 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852249    2524 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852251    2524 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852254    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852256    2524 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852260    2524 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852262    2524 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852264    2524 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852267    2524 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852285    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852288    2524 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852291    2524 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852294    2524 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852297    2524 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852300    2524 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852303    2524 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852306    2524 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:28:19.855869 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852309    2524 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852311    2524 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852314    2524 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852317    2524 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852319    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852322    2524 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852325    2524 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852328    2524 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852331    2524 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852334    2524 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852336    2524 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852339    2524 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852342    2524 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852344    2524 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852346    2524 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852348    2524 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852351    2524 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852353    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852356    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:28:19.856323 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852358    2524 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.852360    2524 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852419    2524 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852425    2524 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852430    2524 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852436    2524 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852439    2524 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852444    2524 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852450    2524 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852456    2524 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852461    2524 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852465    2524 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852471    2524 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852476    2524 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852479    2524 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852482    2524 flags.go:64] FLAG: --cgroup-root=""
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852484    2524 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852487    2524 flags.go:64] FLAG: --client-ca-file=""
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852490    2524 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852492    2524 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852496    2524 flags.go:64] FLAG: --cluster-domain=""
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852499    2524 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852501    2524 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852504    2524 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 16:28:19.856819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852522    2524 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852526    2524 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852528    2524 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852531    2524 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852534    2524 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852537    2524 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852540    2524 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852543    2524 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852545    2524 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852548    2524 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852554    2524 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852556    2524 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852559    2524 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852563    2524 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852565    2524 flags.go:64] FLAG: --enable-server="true"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852568    2524 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852571    2524 flags.go:64] FLAG: --event-burst="100"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852574    2524 flags.go:64] FLAG: --event-qps="50"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852577    2524 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852580    2524 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852582    2524 flags.go:64] FLAG: --eviction-hard=""
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852586    2524 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852589    2524 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852592    2524 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852595    2524 flags.go:64] FLAG: --eviction-soft=""
Jul 21 16:28:19.857376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852597    2524 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852600    2524 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852602    2524 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852605    2524 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852608    2524 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852610    2524 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852613    2524 flags.go:64] FLAG: --feature-gates=""
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852616    2524 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852619    2524 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852622    2524 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852625    2524 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852627    2524 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852630    2524 flags.go:64] FLAG: --help="false"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852633    2524 flags.go:64] FLAG: --hostname-override="ip-10-0-135-103.ec2.internal"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852636    2524 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852639    2524 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852641    2524 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852646    2524 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852649    2524 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852651    2524 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852655    2524 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852658    2524 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852660    2524 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 16:28:19.858131 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852663    2524 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852666    2524 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852668    2524 flags.go:64] FLAG: --kube-reserved=""
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852671    2524 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852674    2524 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852677    2524 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852679    2524 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852682    2524 flags.go:64] FLAG: --lock-file=""
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852685    2524 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852687    2524 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852690    2524 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852695    2524 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852698    2524 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852700    2524 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852703    2524 flags.go:64] FLAG: --logging-format="text"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852705    2524 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852708    2524 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852711    2524 flags.go:64] FLAG: --manifest-url=""
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852713    2524 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852717    2524 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852720    2524 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852724    2524 flags.go:64] FLAG: --max-pods="110"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852726    2524 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852729    2524 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852732    2524 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 16:28:19.859110 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852734    2524 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852738    2524 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852741    2524 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852744    2524 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852751    2524 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852754    2524 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852756    2524 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852759    2524 flags.go:64] FLAG: --pod-cidr=""
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852762    2524 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852767    2524 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852769    2524 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852772    2524 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852775    2524 flags.go:64] FLAG: --port="10250"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852777    2524 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852780    2524 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fd60acdea2c8fe94"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852784    2524 flags.go:64] FLAG: --qos-reserved=""
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852786    2524 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852789    2524 flags.go:64] FLAG: --register-node="true"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852792    2524 flags.go:64] FLAG: --register-with-taints=""
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852795    2524 flags.go:64] FLAG: --registry-burst="10"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852798    2524 flags.go:64] FLAG: --registry-qps="5"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852800    2524 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852803    2524 flags.go:64] FLAG: --reserved-memory=""
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852806    2524 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852809    2524 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 16:28:19.859988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852812    2524 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852814    2524 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852817    2524 flags.go:64] FLAG: --runonce="false"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852819    2524 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852822    2524 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852825    2524 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852827    2524 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852830    2524 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852833    2524 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852838    2524 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852840    2524 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852845    2524 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852847    2524 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852850    2524 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852853    2524 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852855    2524 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852858    2524 flags.go:64] FLAG: --system-cgroups=""
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852861    2524 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852865    2524 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852868    2524 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852871    2524 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852874    2524 flags.go:64] FLAG: --tls-min-version=""
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852877    2524 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852880    2524 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852882    2524 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 16:28:19.860597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852885    2524 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852888    2524 flags.go:64] FLAG: --v="2"
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852891    2524 flags.go:64] FLAG: --version="false"
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852895    2524 flags.go:64] FLAG: --vmodule=""
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852898    2524 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.852901    2524 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853014    2524 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853020    2524 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853026    2524 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853031    2524 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853034    2524 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853037    2524 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853040    2524 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853043    2524 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853046    2524 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853048    2524 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853053    2524 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853056    2524 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853059    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853062    2524 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853064    2524 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:28:19.861246 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853067    2524 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853069    2524 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853072    2524 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853074    2524 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853077    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853079    2524 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853082    2524 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853084    2524 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853087    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853089    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853094    2524 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853097    2524 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853100    2524 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853103    2524 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853106    2524 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853108    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853111    2524 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853113    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853116    2524 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853118    2524 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:28:19.861758 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853121    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853123    2524 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853126    2524 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853128    2524 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853131    2524 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853133    2524 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853136    2524 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853138    2524 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853141    2524 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853144    2524 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853147    2524 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853149    2524 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853151    2524 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853154    2524 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853156    2524 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853158    2524 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853161    2524 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853163    2524 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853165    2524 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853168    2524 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:28:19.862273 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853170    2524 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853173    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853175    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853178    2524 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853180    2524 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853183    2524 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853185    2524 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853188    2524 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853190    2524 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853192    2524 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853195    2524 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853197    2524 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853199    2524 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853202    2524 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853204    2524 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853206    2524 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853209    2524 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853211    2524 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853213    2524 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853216    2524 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:28:19.862748 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853218    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853222    2524 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853224    2524 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853227    2524 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853229    2524 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853231    2524 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853234    2524 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853236    2524 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853239    2524 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853242    2524 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853245    2524 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853248    2524 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853251    2524 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853254    2524 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853257    2524 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853259    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853262    2524 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853265    2524 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853267    2524 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:28:19.863216 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853270    2524 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:28:19.863671 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853273    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:28:19.863671 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853276    2524 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:28:19.863671 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853278    2524 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:28:19.863671 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.853280    2524 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:28:19.863671 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.853285    2524 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:28:19.863671 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.860803    2524 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 16:28:19.863671 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.860817    2524 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 16:28:19.863671 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.861570    2524 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 16:28:19.863671 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.861578    2524 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 16:28:19.863671 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861629    2524 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:28:19.863671 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861634    2524 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:28:19.863671 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861638    2524 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:28:19.863671 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861641    2524 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:28:19.863671 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861644    2524 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:28:19.863671 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861647    2524 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861650    2524 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861653    2524 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861655    2524 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861658    2524 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861660    2524 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861663    2524 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861665    2524 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861668    2524 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861670    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861673    2524 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861676    2524 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861678    2524 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861681    2524 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861684    2524 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861686    2524 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861689    2524 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861691    2524 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861693    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861696    2524 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:28:19.864022 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861699    2524 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861701    2524 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861703    2524 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861706    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861709    2524 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861712    2524 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861714    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861717    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861719    2524 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861722    2524 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861724    2524 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861727    2524 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861729    2524 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861732    2524 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861736    2524 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861739    2524 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861742    2524 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861744    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861747    2524 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861749    2524 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:28:19.864477 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861752    2524 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861755    2524 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861758    2524 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861761    2524 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861764    2524 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861766    2524 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861769    2524 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861771    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861773    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861776    2524 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861778    2524 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861782    2524 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861786    2524 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861789    2524 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861791    2524 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861795    2524 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861797    2524 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861800    2524 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861803    2524 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:28:19.865001 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861805    2524 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861808    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861810    2524 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861813    2524 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861815    2524 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861817    2524 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861820    2524 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861822    2524 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861824    2524 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861827    2524 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861829    2524 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861832    2524 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861834    2524 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861838    2524 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861841    2524 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861844    2524 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861847    2524 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861849    2524 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861852    2524 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861855    2524 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:28:19.865478 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861857    2524 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:28:19.865995 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861859    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:28:19.865995 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861862    2524 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:28:19.865995 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861864    2524 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:28:19.865995 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861867    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:28:19.865995 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861869    2524 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:28:19.865995 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861871    2524 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:28:19.865995 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861874    2524 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:28:19.865995 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861877    2524 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:28:19.865995 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861879    2524 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:28:19.865995 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861882    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:28:19.865995 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861884    2524 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:28:19.865995 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861887    2524 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:28:19.865995 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861889    2524 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:28:19.865995 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.861892    2524 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:28:19.866313 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.861896    2524 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:28:19.866313 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862013    2524 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:28:19.866313 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862018    2524 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:28:19.866313 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862022    2524 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:28:19.866313 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862026    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:28:19.866313 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862029    2524 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:28:19.866313 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862032    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:28:19.866313 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862035    2524 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:28:19.866313 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862038    2524 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:28:19.866313 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862041    2524 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:28:19.866313 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862044    2524 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:28:19.866313 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862047    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:28:19.866313 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862049    2524 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:28:19.866313 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862052    2524 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:28:19.866313 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862055    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862058    2524 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862060    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862063    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862066    2524 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862068    2524 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862070    2524 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862073    2524 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862075    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862077    2524 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862080    2524 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862082    2524 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862085    2524 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862087    2524 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862090    2524 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862092    2524 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862094    2524 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862097    2524 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862099    2524 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862102    2524 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:28:19.866837 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862105    2524 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862107    2524 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862109    2524 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862112    2524 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862114    2524 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862118    2524 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862121    2524 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862123    2524 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862125    2524 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862128    2524 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862130    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862133    2524 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862136    2524 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862138    2524 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862141    2524 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862143    2524 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862146    2524 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862148    2524 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862150    2524 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862153    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:28:19.867611 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862155    2524 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862157    2524 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862159    2524 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862162    2524 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862164    2524 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862168    2524 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862171    2524 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862174    2524 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862177    2524 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862180    2524 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862182    2524 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862185    2524 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862187    2524 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862190    2524 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862192    2524 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862194    2524 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862197    2524 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862199    2524 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862202    2524 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862204    2524 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:28:19.868104 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862206    2524 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862209    2524 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862211    2524 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862214    2524 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862216    2524 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862219    2524 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862221    2524 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862224    2524 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862226    2524 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862228    2524 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862230    2524 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862233    2524 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862235    2524 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862238    2524 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862240    2524 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862242    2524 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862245    2524 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862247    2524 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862250    2524 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:28:19.868773 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862252    2524 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:28:19.869223 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862255    2524 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:28:19.869223 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862257    2524 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:28:19.869223 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862259    2524 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:28:19.869223 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862262    2524 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:28:19.869223 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862264    2524 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:28:19.869223 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:19.862266    2524 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:28:19.869223 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.862271    2524 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:28:19.869223 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.862368    2524 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 16:28:19.869223 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.864990    2524 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 16:28:19.869223 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.866377    2524 server.go:1019] "Starting client certificate rotation"
Jul 21 16:28:19.869223 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.866492    2524 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 16:28:19.869223 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.866553    2524 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 16:28:19.869223 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.868723    2524 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 16:28:19.874173 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.874159    2524 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 16:28:19.885665 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.885649    2524 log.go:25] "Validated CRI v1 runtime API"
Jul 21 16:28:19.887640 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.887628    2524 log.go:25] "Validated CRI v1 image API"
Jul 21 16:28:19.888415 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.888398    2524 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 16:28:19.892103 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.892086    2524 fs.go:135] Filesystem UUIDs: map[52d5155d-d8c3-43a8-ba2a-d42e39f7408c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 87e10bc4-884d-4648-9bae-120e822ae718:/dev/nvme0n1p3]
Jul 21 16:28:19.892162 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.892103    2524 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 16:28:19.895274 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.895231    2524 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 16:28:19.898103 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.897998    2524 manager.go:216] Machine: {Timestamp:2026-07-21 16:28:19.896755664 +0000 UTC m=+0.292986436 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3205254 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2107760dec1af9429aaa3932035b18 SystemUUID:ec210776-0dec-1af9-429a-aa3932035b18 BootID:f1e371ad-01a7-4979-b7b1-60050c0a791a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cd:82:b1:6d:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cd:82:b1:6d:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:f3:83:64:a3:32 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 16:28:19.898103 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.898095    2524 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 16:28:19.898210 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.898158    2524 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 16:28:19.901075 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.901053    2524 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 16:28:19.901196 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.901078    2524 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-103.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 16:28:19.901799 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.901788    2524 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 16:28:19.901831 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.901802    2524 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 16:28:19.901831 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.901810    2524 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 16:28:19.902481 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.902472    2524 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 16:28:19.904016 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.904006    2524 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 16:28:19.908062 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.908050    2524 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 16:28:19.908186 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.908176    2524 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 16:28:19.908228 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.908206    2524 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 16:28:19.908228 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.908215    2524 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 16:28:19.908228 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.908228    2524 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 16:28:19.908324 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.908237    2524 kubelet.go:398] "Adding apiserver pod source"
Jul 21 16:28:19.908324 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.908246    2524 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 16:28:19.908546 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.908535    2524 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 16:28:19.908582 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.908560    2524 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 16:28:19.910482 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.910462    2524 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 16:28:19.912434 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.912421    2524 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 16:28:19.912488 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.912451    2524 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 16:28:19.913636 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.913625    2524 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 16:28:19.913692 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.913640    2524 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 16:28:19.913692 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.913647    2524 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 16:28:19.913692 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.913652    2524 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 16:28:19.913692 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.913660    2524 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 16:28:19.913692 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.913665    2524 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 16:28:19.913692 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.913673    2524 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 16:28:19.913692 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.913677    2524 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 16:28:19.913692 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.913683    2524 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 16:28:19.913692 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.913689    2524 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 16:28:19.913692 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.913697    2524 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 16:28:19.914067 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.913702    2524 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 16:28:19.914977 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.914966    2524 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 16:28:19.914977 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.914976    2524 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 16:28:19.917800 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.917785    2524 server.go:1268] "Started kubelet"
Jul 21 16:28:19.917882 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:19.917806    2524 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 16:28:19.917882 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:19.917806    2524 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 16:28:19.917882 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.917849    2524 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 16:28:19.918040 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.917919    2524 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 16:28:19.918040 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.917975    2524 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 16:28:19.918140 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.918124    2524 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-103.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 16:28:19.919585 ip-10-0-135-103 systemd[1]: Started Kubernetes Kubelet.
Jul 21 16:28:19.919788 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.919771    2524 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 16:28:19.921205 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.921193    2524 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 16:28:19.921442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.921423    2524 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n9mlt"
Jul 21 16:28:19.923684 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:19.923667    2524 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 16:28:19.925125 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:19.924342    2524 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-103.ec2.internal.18c45ae6db89669e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-103.ec2.internal,UID:ip-10-0-135-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-103.ec2.internal,},FirstTimestamp:2026-07-21 16:28:19.917751966 +0000 UTC m=+0.313982737,LastTimestamp:2026-07-21 16:28:19.917751966 +0000 UTC m=+0.313982737,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-103.ec2.internal,}"
Jul 21 16:28:19.926625 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.926608    2524 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 16:28:19.926625 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.926617    2524 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 16:28:19.926733 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:19.926688    2524 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found"
Jul 21 16:28:19.927299 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.927283    2524 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 16:28:19.927439 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.927315    2524 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 16:28:19.927439 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.927328    2524 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 16:28:19.927548 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.927443    2524 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 16:28:19.927548 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.927450    2524 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 16:28:19.928721 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.928699    2524 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n9mlt"
Jul 21 16:28:19.928904 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.928891    2524 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 16:28:19.928984 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.928906    2524 factory.go:55] Registering systemd factory
Jul 21 16:28:19.928984 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.928915    2524 factory.go:223] Registration of the systemd container factory successfully
Jul 21 16:28:19.929147 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.929124    2524 factory.go:153] Registering CRI-O factory
Jul 21 16:28:19.929147 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.929143    2524 factory.go:223] Registration of the crio container factory successfully
Jul 21 16:28:19.929295 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.929164    2524 factory.go:103] Registering Raw factory
Jul 21 16:28:19.929295 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.929176    2524 manager.go:1196] Started watching for new ooms in manager
Jul 21 16:28:19.929769 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.929722    2524 manager.go:349] Starting recovery of all containers
Jul 21 16:28:19.931407 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:19.931360    2524 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 16:28:19.931609 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:19.931584    2524 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 16:28:19.942049 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.941928    2524 manager.go:354] Recovery completed
Jul 21 16:28:19.945981 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.945969    2524 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:28:19.947962 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.947946    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:28:19.948031 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.947974    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:28:19.948031 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.947988    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:28:19.948431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.948417    2524 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 16:28:19.948431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.948430    2524 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 16:28:19.948528 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.948443    2524 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 16:28:19.948528 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.948476    2524 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:28:19.949112 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.949099    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:28:19.949159 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.949121    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:28:19.949159 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.949130    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:28:19.950457 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.950446    2524 policy_none.go:49] "None policy: Start"
Jul 21 16:28:19.950524 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.950464    2524 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 16:28:19.950524 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.950473    2524 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 16:28:19.952536 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.952524    2524 policy_none.go:47] "Start"
Jul 21 16:28:19.991024 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.991008    2524 manager.go:337] "Starting Device Plugin manager"
Jul 21 16:28:19.991092 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:19.991034    2524 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 16:28:19.991092 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.991044    2524 server.go:87] "Starting device plugin registration server"
Jul 21 16:28:19.991297 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.991285    2524 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 16:28:19.991341 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.991325    2524 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 16:28:19.991409 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.991386    2524 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 16:28:19.991501 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.991487    2524 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 16:28:19.991576 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:19.991502    2524 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 16:28:19.992425 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:19.992010    2524 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 16:28:19.992495 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:19.992451    2524 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-103.ec2.internal\" not found"
Jul 21 16:28:20.052335 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.052309    2524 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 16:28:20.054558 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.053535    2524 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 16:28:20.054558 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.053566    2524 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 16:28:20.054558 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.053584    2524 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 16:28:20.054558 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:20.053612    2524 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 16:28:20.055930 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.055910    2524 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:28:20.091850 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.091798    2524 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:28:20.092566 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.092542    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:28:20.092566 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.092569    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:28:20.092675 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.092579    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:28:20.092675 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.092598    2524 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.100702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.100689    2524 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.100747 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:20.100707    2524 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-103.ec2.internal\": node \"ip-10-0-135-103.ec2.internal\" not found"
Jul 21 16:28:20.114007 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:20.113987    2524 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found"
Jul 21 16:28:20.153717 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.153697    2524 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal"]
Jul 21 16:28:20.153773 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.153747    2524 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:28:20.154434 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.154420    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:28:20.154494 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.154443    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:28:20.154494 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.154453    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:28:20.156733 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.156722    2524 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:28:20.156847 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.156833    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.156892 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.156865    2524 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:28:20.157344 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.157327    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:28:20.157404 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.157334    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:28:20.157404 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.157358    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:28:20.157404 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.157372    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:28:20.157404 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.157374    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:28:20.157404 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.157394    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:28:20.159740 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.159728    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.159786 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.159753    2524 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:28:20.160329 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.160316    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:28:20.160406 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.160335    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:28:20.160406 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.160343    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:28:20.177993 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:20.177973    2524 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-103.ec2.internal\" not found" node="ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.181949 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:20.181933    2524 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-103.ec2.internal\" not found" node="ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.214105 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:20.214089    2524 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found"
Jul 21 16:28:20.228752 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.228733    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/357c3a182bc51ecfdc27d1a423b3cb52-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal\" (UID: \"357c3a182bc51ecfdc27d1a423b3cb52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.228820 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.228757    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/357c3a182bc51ecfdc27d1a423b3cb52-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal\" (UID: \"357c3a182bc51ecfdc27d1a423b3cb52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.228820 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.228772    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aa5cb37ed5f2f1567e0eabefb71356fb-config\") pod \"kube-apiserver-proxy-ip-10-0-135-103.ec2.internal\" (UID: \"aa5cb37ed5f2f1567e0eabefb71356fb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.315135 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:20.315107    2524 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found"
Jul 21 16:28:20.329461 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.329440    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/357c3a182bc51ecfdc27d1a423b3cb52-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal\" (UID: \"357c3a182bc51ecfdc27d1a423b3cb52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.329504 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.329475    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/357c3a182bc51ecfdc27d1a423b3cb52-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal\" (UID: \"357c3a182bc51ecfdc27d1a423b3cb52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.329504 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.329494    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aa5cb37ed5f2f1567e0eabefb71356fb-config\") pod \"kube-apiserver-proxy-ip-10-0-135-103.ec2.internal\" (UID: \"aa5cb37ed5f2f1567e0eabefb71356fb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.329621 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.329543    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/357c3a182bc51ecfdc27d1a423b3cb52-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal\" (UID: \"357c3a182bc51ecfdc27d1a423b3cb52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.329621 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.329557    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aa5cb37ed5f2f1567e0eabefb71356fb-config\") pod \"kube-apiserver-proxy-ip-10-0-135-103.ec2.internal\" (UID: \"aa5cb37ed5f2f1567e0eabefb71356fb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.329621 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.329568    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/357c3a182bc51ecfdc27d1a423b3cb52-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal\" (UID: \"357c3a182bc51ecfdc27d1a423b3cb52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.415880 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:20.415840    2524 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found"
Jul 21 16:28:20.482362 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.482337    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.485503 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.485486    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal"
Jul 21 16:28:20.516917 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:20.516888    2524 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found"
Jul 21 16:28:20.617443 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:20.617424    2524 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found"
Jul 21 16:28:20.717912 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:20.717866    2524 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found"
Jul 21 16:28:20.818418 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:20.818397    2524 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found"
Jul 21 16:28:20.865827 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.865809    2524 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 16:28:20.866224 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.865910    2524 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 16:28:20.918607 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:20.918583    2524 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found"
Jul 21 16:28:20.934798 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.934772    2524 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 16:23:20 +0000 UTC" deadline="2028-01-19 04:20:56.19902385 +0000 UTC"
Jul 21 16:28:20.934798 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:20.934796    2524 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13115h52m35.26423056s"
Jul 21 16:28:21.018876 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:21.018852    2524 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found"
Jul 21 16:28:21.047801 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:21.047774    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357c3a182bc51ecfdc27d1a423b3cb52.slice/crio-fa0bb5a37fbb9561a7583ccb055aa3198ba94f084fdc09c6a474aeef2e884352 WatchSource:0}: Error finding container fa0bb5a37fbb9561a7583ccb055aa3198ba94f084fdc09c6a474aeef2e884352: Status 404 returned error can't find the container with id fa0bb5a37fbb9561a7583ccb055aa3198ba94f084fdc09c6a474aeef2e884352
Jul 21 16:28:21.048117 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:21.048097    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5cb37ed5f2f1567e0eabefb71356fb.slice/crio-9b219a5a8474f363805469ce8e0f8f763028f01f163bea957421ca4d1e1377e6 WatchSource:0}: Error finding container 9b219a5a8474f363805469ce8e0f8f763028f01f163bea957421ca4d1e1377e6: Status 404 returned error can't find the container with id 9b219a5a8474f363805469ce8e0f8f763028f01f163bea957421ca4d1e1377e6
Jul 21 16:28:21.054718 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.054701    2524 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:28:21.056556 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.056486    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" event={"ID":"357c3a182bc51ecfdc27d1a423b3cb52","Type":"ContainerStarted","Data":"fa0bb5a37fbb9561a7583ccb055aa3198ba94f084fdc09c6a474aeef2e884352"}
Jul 21 16:28:21.057573 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.057551    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal" event={"ID":"aa5cb37ed5f2f1567e0eabefb71356fb","Type":"ContainerStarted","Data":"9b219a5a8474f363805469ce8e0f8f763028f01f163bea957421ca4d1e1377e6"}
Jul 21 16:28:21.119224 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:21.119203    2524 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-103.ec2.internal\" not found"
Jul 21 16:28:21.193185 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.193166    2524 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:28:21.193964 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.193947    2524 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:28:21.227482 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.227463    2524 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal"
Jul 21 16:28:21.238646 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.238627    2524 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 16:28:21.239495 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.239485    2524 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal"
Jul 21 16:28:21.247318 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.247304    2524 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 16:28:21.432174 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.432126    2524 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:28:21.909719 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.909691    2524 apiserver.go:52] "Watching apiserver"
Jul 21 16:28:21.916600 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.916578    2524 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 16:28:21.917922 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.917899    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-2fs5t","kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal","openshift-image-registry/node-ca-slxwg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal","openshift-multus/network-metrics-daemon-fm4hg","openshift-ovn-kubernetes/ovnkube-node-hj27l","kube-system/konnectivity-agent-fsdc4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8","openshift-cluster-node-tuning-operator/tuned-59jlc","openshift-dns/node-resolver-sz6f7","openshift-multus/multus-additional-cni-plugins-hnkqd","openshift-multus/multus-g4bgp","openshift-network-diagnostics/network-check-target-dqnr9","openshift-network-operator/iptables-alerter-djsl8"]
Jul 21 16:28:21.920623 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.920601    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sz6f7"
Jul 21 16:28:21.923223 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.922954    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:21.923223 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:21.923052    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:21.923223 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.923094    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 16:28:21.923223 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.923096    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 16:28:21.923521 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.923484    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cw8lp\""
Jul 21 16:28:21.925308 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.925286    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-slxwg"
Jul 21 16:28:21.927379 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.927348    2524 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 16:28:21.928534 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.927676    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-djsl8"
Jul 21 16:28:21.928534 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.927830    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 16:28:21.928534 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.927873    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 16:28:21.928534 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.927969    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 16:28:21.928534 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.928402    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4w67h\""
Jul 21 16:28:21.930076 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.930056    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:21.930169 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:21.930132    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:21.932347 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.932326    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nnjjm\""
Jul 21 16:28:21.932423 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.932358    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 16:28:21.932614 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.932581    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:28:21.932660 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.932625    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 16:28:21.933286 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.933252    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:21.935668 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.935650    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 16:28:21.936012 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.935990    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:21.936805 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.936788    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 16:28:21.937134 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.937109    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 16:28:21.937304 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.937282    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 16:28:21.937393 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.937367    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/140d35fe-6c85-41d0-b3b4-4e44ebea0d80-host\") pod \"node-ca-slxwg\" (UID: \"140d35fe-6c85-41d0-b3b4-4e44ebea0d80\") " pod="openshift-image-registry/node-ca-slxwg"
Jul 21 16:28:21.937443 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.937391    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/140d35fe-6c85-41d0-b3b4-4e44ebea0d80-serviceca\") pod \"node-ca-slxwg\" (UID: \"140d35fe-6c85-41d0-b3b4-4e44ebea0d80\") " pod="openshift-image-registry/node-ca-slxwg"
Jul 21 16:28:21.937443 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.937111    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 16:28:21.937443 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.937415    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc78d\" (UniqueName: \"kubernetes.io/projected/246b7811-ef94-4006-98dc-b74c5ae49d93-kube-api-access-vc78d\") pod \"iptables-alerter-djsl8\" (UID: \"246b7811-ef94-4006-98dc-b74c5ae49d93\") " pod="openshift-network-operator/iptables-alerter-djsl8"
Jul 21 16:28:21.937677 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.937115    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 16:28:21.937677 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.937466    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a-hosts-file\") pod \"node-resolver-sz6f7\" (UID: \"dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a\") " pod="openshift-dns/node-resolver-sz6f7"
Jul 21 16:28:21.937677 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.937498    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwht5\" (UniqueName: \"kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5\") pod \"network-check-target-dqnr9\" (UID: \"40ee9f54-597c-4293-af7b-6790edde15f8\") " pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:21.937677 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.937542    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8sqk\" (UniqueName: \"kubernetes.io/projected/140d35fe-6c85-41d0-b3b4-4e44ebea0d80-kube-api-access-j8sqk\") pod \"node-ca-slxwg\" (UID: \"140d35fe-6c85-41d0-b3b4-4e44ebea0d80\") " pod="openshift-image-registry/node-ca-slxwg"
Jul 21 16:28:21.937677 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.937231    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mt5b4\""
Jul 21 16:28:21.937677 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.937567    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/246b7811-ef94-4006-98dc-b74c5ae49d93-iptables-alerter-script\") pod \"iptables-alerter-djsl8\" (UID: \"246b7811-ef94-4006-98dc-b74c5ae49d93\") " pod="openshift-network-operator/iptables-alerter-djsl8"
Jul 21 16:28:21.937677 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.937667    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/246b7811-ef94-4006-98dc-b74c5ae49d93-host-slash\") pod \"iptables-alerter-djsl8\" (UID: \"246b7811-ef94-4006-98dc-b74c5ae49d93\") " pod="openshift-network-operator/iptables-alerter-djsl8"
Jul 21 16:28:21.937991 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.937696    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a-tmp-dir\") pod \"node-resolver-sz6f7\" (UID: \"dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a\") " pod="openshift-dns/node-resolver-sz6f7"
Jul 21 16:28:21.937991 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.937728    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsz7s\" (UniqueName: \"kubernetes.io/projected/dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a-kube-api-access-dsz7s\") pod \"node-resolver-sz6f7\" (UID: \"dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a\") " pod="openshift-dns/node-resolver-sz6f7"
Jul 21 16:28:21.938462 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.938437    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:28:21.939374 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.938764    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 16:28:21.939374 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.939049    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5sgcc\""
Jul 21 16:28:21.939374 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.939075    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fsdc4"
Jul 21 16:28:21.940875 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.940852    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:21.941251 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.941231    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 16:28:21.941649 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.941629    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 16:28:21.941729 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.941693    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g7lmg\""
Jul 21 16:28:21.943432 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.943395    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 16:28:21.943565 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.943548    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 16:28:21.943634 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.943620    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 16:28:21.943843 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.943823    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8xhw4\""
Jul 21 16:28:21.943927 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.943903    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:21.944002 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:21.943966    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:21.944062 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.944032    2524 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 16:28:21.946125 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.946104    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:21.948724 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.948704    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:21.948854 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.948832    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 16:28:21.949143 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.949127    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 16:28:21.949203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.949172    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 16:28:21.949336 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.949323    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 16:28:21.949392 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.949365    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 16:28:21.949514 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.949502    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-86c6v\""
Jul 21 16:28:21.951010 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.950994    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 16:28:21.951300 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.950994    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s77hd\""
Jul 21 16:28:21.969507 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.969486    2524 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wwwjj"
Jul 21 16:28:21.977921 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:21.977901    2524 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wwwjj"
Jul 21 16:28:22.031326 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.028735    2524 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 16:28:22.038482 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038454    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-run-systemd\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.038612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038496    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/140d35fe-6c85-41d0-b3b4-4e44ebea0d80-host\") pod \"node-ca-slxwg\" (UID: \"140d35fe-6c85-41d0-b3b4-4e44ebea0d80\") " pod="openshift-image-registry/node-ca-slxwg"
Jul 21 16:28:22.038612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038542    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e501c98a-cee2-4fcd-a73f-17833cd531f8-konnectivity-ca\") pod \"konnectivity-agent-fsdc4\" (UID: \"e501c98a-cee2-4fcd-a73f-17833cd531f8\") " pod="kube-system/konnectivity-agent-fsdc4"
Jul 21 16:28:22.038612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038572    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqd29\" (UniqueName: \"kubernetes.io/projected/f999015a-d707-4f1f-9e86-a69a77ada0d0-kube-api-access-vqd29\") pod \"network-metrics-daemon-fm4hg\" (UID: \"f999015a-d707-4f1f-9e86-a69a77ada0d0\") " pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:22.038612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038599    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-systemd-units\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.038823 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038624    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76e0f479-501e-44c3-a0fe-fb743653ffd9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.038823 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038650    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-multus-socket-dir-parent\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.038823 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038677    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-run-multus-certs\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.038823 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038703    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-host\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.038823 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038730    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-registration-dir\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.038823 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038757    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21a141c5-caee-4617-9653-0ce807c62883-ovn-node-metrics-cert\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.038823 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038782    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-var-lib-cni-bin\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.038823 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038808    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13f10258-5610-4e94-b3b8-edbabda5ad24-multus-daemon-config\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.039203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038839    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsz7s\" (UniqueName: \"kubernetes.io/projected/dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a-kube-api-access-dsz7s\") pod \"node-resolver-sz6f7\" (UID: \"dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a\") " pod="openshift-dns/node-resolver-sz6f7"
Jul 21 16:28:22.039203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038868    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/140d35fe-6c85-41d0-b3b4-4e44ebea0d80-serviceca\") pod \"node-ca-slxwg\" (UID: \"140d35fe-6c85-41d0-b3b4-4e44ebea0d80\") " pod="openshift-image-registry/node-ca-slxwg"
Jul 21 16:28:22.039203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038893    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-sysctl-conf\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.039203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038921    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.039203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038951    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-var-lib-kubelet\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.039203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.038980    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/246b7811-ef94-4006-98dc-b74c5ae49d93-host-slash\") pod \"iptables-alerter-djsl8\" (UID: \"246b7811-ef94-4006-98dc-b74c5ae49d93\") " pod="openshift-network-operator/iptables-alerter-djsl8"
Jul 21 16:28:22.039203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039005    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-sysctl-d\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.039203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039030    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b48g\" (UniqueName: \"kubernetes.io/projected/d3d7d75b-ca1e-415a-85ef-83492a25da93-kube-api-access-8b48g\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.039203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039058    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-kubelet\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.039203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039089    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-slash\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.039203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039118    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-run-ovn-kubernetes\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.039203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039146    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-cni-netd\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.039203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039170    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-os-release\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.039203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039200    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc78d\" (UniqueName: \"kubernetes.io/projected/246b7811-ef94-4006-98dc-b74c5ae49d93-kube-api-access-vc78d\") pod \"iptables-alerter-djsl8\" (UID: \"246b7811-ef94-4006-98dc-b74c5ae49d93\") " pod="openshift-network-operator/iptables-alerter-djsl8"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039227    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-kubernetes\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039259    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-sys\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039284    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-lib-modules\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039311    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039338    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-socket-dir\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039364    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-etc-selinux\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039392    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2h9j\" (UniqueName: \"kubernetes.io/projected/21a141c5-caee-4617-9653-0ce807c62883-kube-api-access-w2h9j\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039424    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-modprobe-d\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039451    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3d7d75b-ca1e-415a-85ef-83492a25da93-tmp\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039515    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-dbus\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039543    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-etc-openvswitch\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039571    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-run-ovn\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039621    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76e0f479-501e-44c3-a0fe-fb743653ffd9-cnibin\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039653    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76e0f479-501e-44c3-a0fe-fb743653ffd9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039686    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a-tmp-dir\") pod \"node-resolver-sz6f7\" (UID: \"dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a\") " pod="openshift-dns/node-resolver-sz6f7"
Jul 21 16:28:22.039905 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039713    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-run\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039746    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e501c98a-cee2-4fcd-a73f-17833cd531f8-agent-certs\") pod \"konnectivity-agent-fsdc4\" (UID: \"e501c98a-cee2-4fcd-a73f-17833cd531f8\") " pod="kube-system/konnectivity-agent-fsdc4"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039773    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72bg5\" (UniqueName: \"kubernetes.io/projected/373465c7-9017-4c06-92b2-47a673d8ecfc-kube-api-access-72bg5\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039800    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039830    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21a141c5-caee-4617-9653-0ce807c62883-ovnkube-config\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039864    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-multus-cni-dir\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039892    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-run-netns\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039920    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a-hosts-file\") pod \"node-resolver-sz6f7\" (UID: \"dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a\") " pod="openshift-dns/node-resolver-sz6f7"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039952    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwht5\" (UniqueName: \"kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5\") pod \"network-check-target-dqnr9\" (UID: \"40ee9f54-597c-4293-af7b-6790edde15f8\") " pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.039985    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-sysconfig\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040012    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs\") pod \"network-metrics-daemon-fm4hg\" (UID: \"f999015a-d707-4f1f-9e86-a69a77ada0d0\") " pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040042    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76e0f479-501e-44c3-a0fe-fb743653ffd9-system-cni-dir\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040071    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76e0f479-501e-44c3-a0fe-fb743653ffd9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040102    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx62z\" (UniqueName: \"kubernetes.io/projected/13f10258-5610-4e94-b3b8-edbabda5ad24-kube-api-access-xx62z\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040130    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-hostroot\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040156    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-etc-kubernetes\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.040702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040198    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-var-lib-kubelet\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040225    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-cni-bin\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040255    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76e0f479-501e-44c3-a0fe-fb743653ffd9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040299    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13f10258-5610-4e94-b3b8-edbabda5ad24-cni-binary-copy\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040328    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-var-lib-cni-multus\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040354    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-systemd\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040382    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-sys-fs\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040409    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-var-lib-openvswitch\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040439    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21a141c5-caee-4617-9653-0ce807c62883-ovnkube-script-lib\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040467    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-cnibin\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040500    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-run-k8s-cni-cncf-io\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040531    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21a141c5-caee-4617-9653-0ce807c62883-env-overrides\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040559    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76e0f479-501e-44c3-a0fe-fb743653ffd9-os-release\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040623    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-tuned\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040654    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-system-cni-dir\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040692    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8sqk\" (UniqueName: \"kubernetes.io/projected/140d35fe-6c85-41d0-b3b4-4e44ebea0d80-kube-api-access-j8sqk\") pod \"node-ca-slxwg\" (UID: \"140d35fe-6c85-41d0-b3b4-4e44ebea0d80\") " pod="openshift-image-registry/node-ca-slxwg"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040756    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/140d35fe-6c85-41d0-b3b4-4e44ebea0d80-host\") pod \"node-ca-slxwg\" (UID: \"140d35fe-6c85-41d0-b3b4-4e44ebea0d80\") " pod="openshift-image-registry/node-ca-slxwg"
Jul 21 16:28:22.041502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040829    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/246b7811-ef94-4006-98dc-b74c5ae49d93-host-slash\") pod \"iptables-alerter-djsl8\" (UID: \"246b7811-ef94-4006-98dc-b74c5ae49d93\") " pod="openshift-network-operator/iptables-alerter-djsl8"
Jul 21 16:28:22.042338 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040938    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/246b7811-ef94-4006-98dc-b74c5ae49d93-iptables-alerter-script\") pod \"iptables-alerter-djsl8\" (UID: \"246b7811-ef94-4006-98dc-b74c5ae49d93\") " pod="openshift-network-operator/iptables-alerter-djsl8"
Jul 21 16:28:22.042338 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.040978    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-node-log\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.042338 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.041007    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-log-socket\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.042338 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.041040    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wfg9\" (UniqueName: \"kubernetes.io/projected/76e0f479-501e-44c3-a0fe-fb743653ffd9-kube-api-access-5wfg9\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.042338 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.041072    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-run-openvswitch\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.042338 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.041078    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a-tmp-dir\") pod \"node-resolver-sz6f7\" (UID: \"dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a\") " pod="openshift-dns/node-resolver-sz6f7"
Jul 21 16:28:22.042338 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.041043    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a-hosts-file\") pod \"node-resolver-sz6f7\" (UID: \"dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a\") " pod="openshift-dns/node-resolver-sz6f7"
Jul 21 16:28:22.042338 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.041134    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-multus-conf-dir\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.042338 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.041177    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-device-dir\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.042338 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.041208    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-kubelet-config\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:22.042338 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.041238    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-run-netns\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.042338 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.041328    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/140d35fe-6c85-41d0-b3b4-4e44ebea0d80-serviceca\") pod \"node-ca-slxwg\" (UID: \"140d35fe-6c85-41d0-b3b4-4e44ebea0d80\") " pod="openshift-image-registry/node-ca-slxwg"
Jul 21 16:28:22.042338 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.041597    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/246b7811-ef94-4006-98dc-b74c5ae49d93-iptables-alerter-script\") pod \"iptables-alerter-djsl8\" (UID: \"246b7811-ef94-4006-98dc-b74c5ae49d93\") " pod="openshift-network-operator/iptables-alerter-djsl8"
Jul 21 16:28:22.051325 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.051295    2524 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 16:28:22.051439 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.051359    2524 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:28:22.051439 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.051382    2524 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:28:22.051439 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.051395    2524 projected.go:196] Error preparing data for projected volume kube-api-access-fwht5 for pod openshift-network-diagnostics/network-check-target-dqnr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:22.051580 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.051463    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5 podName:40ee9f54-597c-4293-af7b-6790edde15f8 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:22.551445531 +0000 UTC m=+2.947676291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fwht5" (UniqueName: "kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5") pod "network-check-target-dqnr9" (UID: "40ee9f54-597c-4293-af7b-6790edde15f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:22.054924 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.054894    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc78d\" (UniqueName: \"kubernetes.io/projected/246b7811-ef94-4006-98dc-b74c5ae49d93-kube-api-access-vc78d\") pod \"iptables-alerter-djsl8\" (UID: \"246b7811-ef94-4006-98dc-b74c5ae49d93\") " pod="openshift-network-operator/iptables-alerter-djsl8"
Jul 21 16:28:22.054924 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.054912    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsz7s\" (UniqueName: \"kubernetes.io/projected/dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a-kube-api-access-dsz7s\") pod \"node-resolver-sz6f7\" (UID: \"dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a\") " pod="openshift-dns/node-resolver-sz6f7"
Jul 21 16:28:22.055177 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.055152    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8sqk\" (UniqueName: \"kubernetes.io/projected/140d35fe-6c85-41d0-b3b4-4e44ebea0d80-kube-api-access-j8sqk\") pod \"node-ca-slxwg\" (UID: \"140d35fe-6c85-41d0-b3b4-4e44ebea0d80\") " pod="openshift-image-registry/node-ca-slxwg"
Jul 21 16:28:22.141488 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141454    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13f10258-5610-4e94-b3b8-edbabda5ad24-multus-daemon-config\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.141647 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141497    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-sysctl-conf\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.141647 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141540    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.141647 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141567    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-var-lib-kubelet\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.141647 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141591    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-sysctl-d\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.141647 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141614    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b48g\" (UniqueName: \"kubernetes.io/projected/d3d7d75b-ca1e-415a-85ef-83492a25da93-kube-api-access-8b48g\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.141647 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141634    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-kubelet\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141656    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-slash\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141673    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-sysctl-conf\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141679    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-run-ovn-kubernetes\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141712    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-cni-netd\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141726    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-run-ovn-kubernetes\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141737    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-os-release\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141763    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-kubernetes\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141780    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141787    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-sys\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141811    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-lib-modules\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141819    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-var-lib-kubelet\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141835    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141857    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-socket-dir\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141878    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-etc-selinux\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141901    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2h9j\" (UniqueName: \"kubernetes.io/projected/21a141c5-caee-4617-9653-0ce807c62883-kube-api-access-w2h9j\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141922    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-sysctl-d\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.141931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141926    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-modprobe-d\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141949    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3d7d75b-ca1e-415a-85ef-83492a25da93-tmp\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.141972    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-dbus\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142001    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-etc-openvswitch\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142024    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-run-ovn\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142047    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76e0f479-501e-44c3-a0fe-fb743653ffd9-cnibin\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142072    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76e0f479-501e-44c3-a0fe-fb743653ffd9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142096    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-run\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142120    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e501c98a-cee2-4fcd-a73f-17833cd531f8-agent-certs\") pod \"konnectivity-agent-fsdc4\" (UID: \"e501c98a-cee2-4fcd-a73f-17833cd531f8\") " pod="kube-system/konnectivity-agent-fsdc4"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142143    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13f10258-5610-4e94-b3b8-edbabda5ad24-multus-daemon-config\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142175    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-kubelet\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142173    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72bg5\" (UniqueName: \"kubernetes.io/projected/373465c7-9017-4c06-92b2-47a673d8ecfc-kube-api-access-72bg5\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142216    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-slash\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142223    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142233    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-etc-selinux\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142262    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-etc-openvswitch\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142273    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21a141c5-caee-4617-9653-0ce807c62883-ovnkube-config\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.142787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142286    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-cni-netd\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142301    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-multus-cni-dir\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142332    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-run-netns\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142349    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-os-release\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142360    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-modprobe-d\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142377    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-sysconfig\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142397    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-kubernetes\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142407    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs\") pod \"network-metrics-daemon-fm4hg\" (UID: \"f999015a-d707-4f1f-9e86-a69a77ada0d0\") " pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142436    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76e0f479-501e-44c3-a0fe-fb743653ffd9-system-cni-dir\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142445    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-sys\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142469    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76e0f479-501e-44c3-a0fe-fb743653ffd9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142539    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76e0f479-501e-44c3-a0fe-fb743653ffd9-cnibin\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142576    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx62z\" (UniqueName: \"kubernetes.io/projected/13f10258-5610-4e94-b3b8-edbabda5ad24-kube-api-access-xx62z\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142595    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-hostroot\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142574    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-lib-modules\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142617    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-etc-kubernetes\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142636    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-var-lib-kubelet\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142651    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-cni-bin\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.143711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142655    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142667    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76e0f479-501e-44c3-a0fe-fb743653ffd9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142704    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13f10258-5610-4e94-b3b8-edbabda5ad24-cni-binary-copy\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142737    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-var-lib-cni-multus\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142762    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-systemd\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142764    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-socket-dir\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.142815    2524 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142821    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-systemd\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142870    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-run-ovn\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.142883    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret podName:1be3dca0-631a-4ebd-9bfc-2cb14e931f47 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:22.642861378 +0000 UTC m=+3.039092153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret") pod "global-pull-secret-syncer-2fs5t" (UID: "1be3dca0-631a-4ebd-9bfc-2cb14e931f47") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.142835    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-sys-fs\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143027    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-var-lib-openvswitch\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143072    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21a141c5-caee-4617-9653-0ce807c62883-ovnkube-script-lib\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143097    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-cnibin\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143103    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76e0f479-501e-44c3-a0fe-fb743653ffd9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143126    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-run-k8s-cni-cncf-io\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143171    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-run\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.144610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143188    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-sys-fs\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143198    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-run-k8s-cni-cncf-io\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143220    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21a141c5-caee-4617-9653-0ce807c62883-env-overrides\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143252    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76e0f479-501e-44c3-a0fe-fb743653ffd9-os-release\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143277    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-tuned\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143299    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-system-cni-dir\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143326    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-node-log\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143351    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-log-socket\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143360    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-dbus\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143383    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wfg9\" (UniqueName: \"kubernetes.io/projected/76e0f479-501e-44c3-a0fe-fb743653ffd9-kube-api-access-5wfg9\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143404    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-hostroot\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143418    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-run-openvswitch\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143448    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-multus-conf-dir\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143447    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/21a141c5-caee-4617-9653-0ce807c62883-ovnkube-config\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143479    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-device-dir\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143492    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-var-lib-openvswitch\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143505    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-kubelet-config\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143529    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-multus-cni-dir\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.145612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143535    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-run-netns\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143562    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-run-systemd\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143593    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76e0f479-501e-44c3-a0fe-fb743653ffd9-os-release\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143608    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e501c98a-cee2-4fcd-a73f-17833cd531f8-konnectivity-ca\") pod \"konnectivity-agent-fsdc4\" (UID: \"e501c98a-cee2-4fcd-a73f-17833cd531f8\") " pod="kube-system/konnectivity-agent-fsdc4"
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143609    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-run-netns\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143674    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-log-socket\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.143700    2524 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.143747    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs podName:f999015a-d707-4f1f-9e86-a69a77ada0d0 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:22.643731453 +0000 UTC m=+3.039962214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs") pod "network-metrics-daemon-fm4hg" (UID: "f999015a-d707-4f1f-9e86-a69a77ada0d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143782    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/21a141c5-caee-4617-9653-0ce807c62883-ovnkube-script-lib\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143792    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-sysconfig\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143870    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-etc-kubernetes\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143933    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-run-openvswitch\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143978    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-cni-bin\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144012    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-kubelet-config\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144047    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-host-run-netns\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144072    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-multus-conf-dir\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.143451    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-cnibin\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.146516 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144137    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-system-cni-dir\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144151    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqd29\" (UniqueName: \"kubernetes.io/projected/f999015a-d707-4f1f-9e86-a69a77ada0d0-kube-api-access-vqd29\") pod \"network-metrics-daemon-fm4hg\" (UID: \"f999015a-d707-4f1f-9e86-a69a77ada0d0\") " pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144187    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-systemd-units\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144195    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-device-dir\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144217    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76e0f479-501e-44c3-a0fe-fb743653ffd9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144246    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-multus-socket-dir-parent\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144274    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-run-multus-certs\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144281    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76e0f479-501e-44c3-a0fe-fb743653ffd9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144298    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-host\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144326    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-registration-dir\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144350    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21a141c5-caee-4617-9653-0ce807c62883-ovn-node-metrics-cert\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144333    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-node-log\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144374    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-var-lib-cni-bin\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144402    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76e0f479-501e-44c3-a0fe-fb743653ffd9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144411    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76e0f479-501e-44c3-a0fe-fb743653ffd9-system-cni-dir\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144443    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-var-lib-cni-bin\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144465    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-var-lib-cni-multus\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.147431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144520    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-var-lib-kubelet\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.148298 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144560    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-host-run-multus-certs\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.148298 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144617    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-systemd-units\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.148298 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144646    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21a141c5-caee-4617-9653-0ce807c62883-env-overrides\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.148298 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144691    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3d7d75b-ca1e-415a-85ef-83492a25da93-host\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.148298 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144717    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/21a141c5-caee-4617-9653-0ce807c62883-run-systemd\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.148298 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144744    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/373465c7-9017-4c06-92b2-47a673d8ecfc-registration-dir\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.148298 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144768    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76e0f479-501e-44c3-a0fe-fb743653ffd9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.148298 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.144779    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13f10258-5610-4e94-b3b8-edbabda5ad24-multus-socket-dir-parent\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.148298 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.145089    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e501c98a-cee2-4fcd-a73f-17833cd531f8-konnectivity-ca\") pod \"konnectivity-agent-fsdc4\" (UID: \"e501c98a-cee2-4fcd-a73f-17833cd531f8\") " pod="kube-system/konnectivity-agent-fsdc4"
Jul 21 16:28:22.148298 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.145674    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e501c98a-cee2-4fcd-a73f-17833cd531f8-agent-certs\") pod \"konnectivity-agent-fsdc4\" (UID: \"e501c98a-cee2-4fcd-a73f-17833cd531f8\") " pod="kube-system/konnectivity-agent-fsdc4"
Jul 21 16:28:22.148298 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.145750    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3d7d75b-ca1e-415a-85ef-83492a25da93-tmp\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.148298 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.146471    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d3d7d75b-ca1e-415a-85ef-83492a25da93-etc-tuned\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.148298 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.148084    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/21a141c5-caee-4617-9653-0ce807c62883-ovn-node-metrics-cert\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.151695 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.151669    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b48g\" (UniqueName: \"kubernetes.io/projected/d3d7d75b-ca1e-415a-85ef-83492a25da93-kube-api-access-8b48g\") pod \"tuned-59jlc\" (UID: \"d3d7d75b-ca1e-415a-85ef-83492a25da93\") " pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.151807 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.151703    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13f10258-5610-4e94-b3b8-edbabda5ad24-cni-binary-copy\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.152374 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.152331    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx62z\" (UniqueName: \"kubernetes.io/projected/13f10258-5610-4e94-b3b8-edbabda5ad24-kube-api-access-xx62z\") pod \"multus-g4bgp\" (UID: \"13f10258-5610-4e94-b3b8-edbabda5ad24\") " pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.155388 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.155211    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2h9j\" (UniqueName: \"kubernetes.io/projected/21a141c5-caee-4617-9653-0ce807c62883-kube-api-access-w2h9j\") pod \"ovnkube-node-hj27l\" (UID: \"21a141c5-caee-4617-9653-0ce807c62883\") " pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.155388 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.155273    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72bg5\" (UniqueName: \"kubernetes.io/projected/373465c7-9017-4c06-92b2-47a673d8ecfc-kube-api-access-72bg5\") pod \"aws-ebs-csi-driver-node-52lq8\" (UID: \"373465c7-9017-4c06-92b2-47a673d8ecfc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.158972 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.158936    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wfg9\" (UniqueName: \"kubernetes.io/projected/76e0f479-501e-44c3-a0fe-fb743653ffd9-kube-api-access-5wfg9\") pod \"multus-additional-cni-plugins-hnkqd\" (UID: \"76e0f479-501e-44c3-a0fe-fb743653ffd9\") " pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.160646 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.159278    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqd29\" (UniqueName: \"kubernetes.io/projected/f999015a-d707-4f1f-9e86-a69a77ada0d0-kube-api-access-vqd29\") pod \"network-metrics-daemon-fm4hg\" (UID: \"f999015a-d707-4f1f-9e86-a69a77ada0d0\") " pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:22.222554 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.222510    2524 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:28:22.235768 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.235748    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sz6f7"
Jul 21 16:28:22.244468 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.244446    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-slxwg"
Jul 21 16:28:22.254612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.254582    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-59jlc"
Jul 21 16:28:22.261369 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.261349    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-djsl8"
Jul 21 16:28:22.268448 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.268429    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:22.275366 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.275347    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fsdc4"
Jul 21 16:28:22.282442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.282313    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8"
Jul 21 16:28:22.290187 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.290164    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hnkqd"
Jul 21 16:28:22.296206 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.296187    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g4bgp"
Jul 21 16:28:22.647183 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.647147    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:22.647183 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.647185    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwht5\" (UniqueName: \"kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5\") pod \"network-check-target-dqnr9\" (UID: \"40ee9f54-597c-4293-af7b-6790edde15f8\") " pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:22.647426 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.647213    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs\") pod \"network-metrics-daemon-fm4hg\" (UID: \"f999015a-d707-4f1f-9e86-a69a77ada0d0\") " pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:22.647426 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.647308    2524 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:22.647426 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.647332    2524 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:22.647426 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.647339    2524 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:28:22.647426 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.647360    2524 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:28:22.647426 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.647375    2524 projected.go:196] Error preparing data for projected volume kube-api-access-fwht5 for pod openshift-network-diagnostics/network-check-target-dqnr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:22.647426 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.647379    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret podName:1be3dca0-631a-4ebd-9bfc-2cb14e931f47 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:23.647359152 +0000 UTC m=+4.043589913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret") pod "global-pull-secret-syncer-2fs5t" (UID: "1be3dca0-631a-4ebd-9bfc-2cb14e931f47") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:22.647426 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.647395    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs podName:f999015a-d707-4f1f-9e86-a69a77ada0d0 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:23.647387755 +0000 UTC m=+4.043618515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs") pod "network-metrics-daemon-fm4hg" (UID: "f999015a-d707-4f1f-9e86-a69a77ada0d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:22.647426 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:22.647419    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5 podName:40ee9f54-597c-4293-af7b-6790edde15f8 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:23.647403493 +0000 UTC m=+4.043634253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fwht5" (UniqueName: "kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5") pod "network-check-target-dqnr9" (UID: "40ee9f54-597c-4293-af7b-6790edde15f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:22.981886 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.981791    2524 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:23:22 +0000 UTC" deadline="2028-02-10 11:32:20.32656607 +0000 UTC"
Jul 21 16:28:22.981886 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:22.981835    2524 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13651h3m57.344733543s"
Jul 21 16:28:23.133909 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:23.133826    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a141c5_caee_4617_9653_0ce807c62883.slice/crio-d7d34a0a83232c4c194dc915edc39e4fc6bf93d29cf8565574a48d8d199ac625 WatchSource:0}: Error finding container d7d34a0a83232c4c194dc915edc39e4fc6bf93d29cf8565574a48d8d199ac625: Status 404 returned error can't find the container with id d7d34a0a83232c4c194dc915edc39e4fc6bf93d29cf8565574a48d8d199ac625
Jul 21 16:28:23.134639 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:23.134612    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e0f479_501e_44c3_a0fe_fb743653ffd9.slice/crio-00263a513a33c9ebcb25013d0fe3db2f6d4b77cc5e1ccfb66d8b1cc9a6e9da19 WatchSource:0}: Error finding container 00263a513a33c9ebcb25013d0fe3db2f6d4b77cc5e1ccfb66d8b1cc9a6e9da19: Status 404 returned error can't find the container with id 00263a513a33c9ebcb25013d0fe3db2f6d4b77cc5e1ccfb66d8b1cc9a6e9da19
Jul 21 16:28:23.135995 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:23.135974    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d7d75b_ca1e_415a_85ef_83492a25da93.slice/crio-f1d615280e2d3ce31bbbb14809d49a921526088090980b8cb603214ba2e7db8f WatchSource:0}: Error finding container f1d615280e2d3ce31bbbb14809d49a921526088090980b8cb603214ba2e7db8f: Status 404 returned error can't find the container with id f1d615280e2d3ce31bbbb14809d49a921526088090980b8cb603214ba2e7db8f
Jul 21 16:28:23.139410 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:23.139379    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode501c98a_cee2_4fcd_a73f_17833cd531f8.slice/crio-59f835ccb1e148164af12a836174a43a9203f4c0336d5ce11d2abffa87fe62c3 WatchSource:0}: Error finding container 59f835ccb1e148164af12a836174a43a9203f4c0336d5ce11d2abffa87fe62c3: Status 404 returned error can't find the container with id 59f835ccb1e148164af12a836174a43a9203f4c0336d5ce11d2abffa87fe62c3
Jul 21 16:28:23.143584 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:23.143422    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373465c7_9017_4c06_92b2_47a673d8ecfc.slice/crio-19da8591106a8f4429d2cac2f468f8704aca89b95a5f5901f3b90246ed954a28 WatchSource:0}: Error finding container 19da8591106a8f4429d2cac2f468f8704aca89b95a5f5901f3b90246ed954a28: Status 404 returned error can't find the container with id 19da8591106a8f4429d2cac2f468f8704aca89b95a5f5901f3b90246ed954a28
Jul 21 16:28:23.143901 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:23.143880    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod140d35fe_6c85_41d0_b3b4_4e44ebea0d80.slice/crio-2acb6bcadf3e8041d8d95d1f7358a8f2614b1ab12c6c6cb66108d668de3274be WatchSource:0}: Error finding container 2acb6bcadf3e8041d8d95d1f7358a8f2614b1ab12c6c6cb66108d668de3274be: Status 404 returned error can't find the container with id 2acb6bcadf3e8041d8d95d1f7358a8f2614b1ab12c6c6cb66108d668de3274be
Jul 21 16:28:23.144107 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:23.144082    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod246b7811_ef94_4006_98dc_b74c5ae49d93.slice/crio-1802e244523d060a4008f3c6e89bd617607f28f3f41feb97f45aae7b65abf5ae WatchSource:0}: Error finding container 1802e244523d060a4008f3c6e89bd617607f28f3f41feb97f45aae7b65abf5ae: Status 404 returned error can't find the container with id 1802e244523d060a4008f3c6e89bd617607f28f3f41feb97f45aae7b65abf5ae
Jul 21 16:28:23.168725 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:23.168686    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddafdfbab_2e08_4ce4_bf0f_2efb77e9f40a.slice/crio-5d741ab3a2e794d02b0eb8da58f6e7bb9936cb192cda2aaee93d8064f3b99c48 WatchSource:0}: Error finding container 5d741ab3a2e794d02b0eb8da58f6e7bb9936cb192cda2aaee93d8064f3b99c48: Status 404 returned error can't find the container with id 5d741ab3a2e794d02b0eb8da58f6e7bb9936cb192cda2aaee93d8064f3b99c48
Jul 21 16:28:23.169866 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:28:23.169847    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f10258_5610_4e94_b3b8_edbabda5ad24.slice/crio-a0d63dc30ea049edc6364004f197d315ddbd59624e9a3af436967a7835f09167 WatchSource:0}: Error finding container a0d63dc30ea049edc6364004f197d315ddbd59624e9a3af436967a7835f09167: Status 404 returned error can't find the container with id a0d63dc30ea049edc6364004f197d315ddbd59624e9a3af436967a7835f09167
Jul 21 16:28:23.654264 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:23.654226    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:23.654459 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:23.654287    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwht5\" (UniqueName: \"kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5\") pod \"network-check-target-dqnr9\" (UID: \"40ee9f54-597c-4293-af7b-6790edde15f8\") " pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:23.654459 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:23.654315    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs\") pod \"network-metrics-daemon-fm4hg\" (UID: \"f999015a-d707-4f1f-9e86-a69a77ada0d0\") " pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:23.654632 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:23.654486    2524 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:23.654632 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:23.654549    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs podName:f999015a-d707-4f1f-9e86-a69a77ada0d0 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:25.654528606 +0000 UTC m=+6.050759372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs") pod "network-metrics-daemon-fm4hg" (UID: "f999015a-d707-4f1f-9e86-a69a77ada0d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:23.654755 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:23.654639    2524 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:23.654755 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:23.654681    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret podName:1be3dca0-631a-4ebd-9bfc-2cb14e931f47 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:25.654667322 +0000 UTC m=+6.050898084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret") pod "global-pull-secret-syncer-2fs5t" (UID: "1be3dca0-631a-4ebd-9bfc-2cb14e931f47") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:23.654896 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:23.654763    2524 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:28:23.654896 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:23.654781    2524 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:28:23.654896 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:23.654794    2524 projected.go:196] Error preparing data for projected volume kube-api-access-fwht5 for pod openshift-network-diagnostics/network-check-target-dqnr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:23.654896 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:23.654831    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5 podName:40ee9f54-597c-4293-af7b-6790edde15f8 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:25.65481961 +0000 UTC m=+6.051050386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fwht5" (UniqueName: "kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5") pod "network-check-target-dqnr9" (UID: "40ee9f54-597c-4293-af7b-6790edde15f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:23.983079 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:23.983039    2524 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:23:22 +0000 UTC" deadline="2028-02-02 04:34:18.031313342 +0000 UTC"
Jul 21 16:28:23.983079 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:23.983079    2524 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13452h5m54.048240563s"
Jul 21 16:28:24.057626 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:24.056481    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:24.057626 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:24.056629    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:24.057626 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:24.057040    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:24.057626 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:24.057138    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:24.057626 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:24.057206    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:24.057626 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:24.057289    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:24.072822 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:24.072770    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fsdc4" event={"ID":"e501c98a-cee2-4fcd-a73f-17833cd531f8","Type":"ContainerStarted","Data":"59f835ccb1e148164af12a836174a43a9203f4c0336d5ce11d2abffa87fe62c3"}
Jul 21 16:28:24.091187 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:24.091009    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-59jlc" event={"ID":"d3d7d75b-ca1e-415a-85ef-83492a25da93","Type":"ContainerStarted","Data":"f1d615280e2d3ce31bbbb14809d49a921526088090980b8cb603214ba2e7db8f"}
Jul 21 16:28:24.104596 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:24.104477    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l" event={"ID":"21a141c5-caee-4617-9653-0ce807c62883","Type":"ContainerStarted","Data":"d7d34a0a83232c4c194dc915edc39e4fc6bf93d29cf8565574a48d8d199ac625"}
Jul 21 16:28:24.122664 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:24.122635    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g4bgp" event={"ID":"13f10258-5610-4e94-b3b8-edbabda5ad24","Type":"ContainerStarted","Data":"a0d63dc30ea049edc6364004f197d315ddbd59624e9a3af436967a7835f09167"}
Jul 21 16:28:24.127298 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:24.127271    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8" event={"ID":"373465c7-9017-4c06-92b2-47a673d8ecfc","Type":"ContainerStarted","Data":"19da8591106a8f4429d2cac2f468f8704aca89b95a5f5901f3b90246ed954a28"}
Jul 21 16:28:24.134856 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:24.134800    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnkqd" event={"ID":"76e0f479-501e-44c3-a0fe-fb743653ffd9","Type":"ContainerStarted","Data":"00263a513a33c9ebcb25013d0fe3db2f6d4b77cc5e1ccfb66d8b1cc9a6e9da19"}
Jul 21 16:28:24.149925 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:24.149893    2524 generic.go:356] "Generic (PLEG): container finished" podID="357c3a182bc51ecfdc27d1a423b3cb52" containerID="0bdab4dc4405538f3f23e98af0be48f33a3a0f2266fd49f242a409e19972c239" exitCode=0
Jul 21 16:28:24.150034 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:24.149968    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" event={"ID":"357c3a182bc51ecfdc27d1a423b3cb52","Type":"ContainerDied","Data":"0bdab4dc4405538f3f23e98af0be48f33a3a0f2266fd49f242a409e19972c239"}
Jul 21 16:28:24.159632 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:24.159602    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal" event={"ID":"aa5cb37ed5f2f1567e0eabefb71356fb","Type":"ContainerStarted","Data":"233f4e3e6e4e6f0054febdf14ea959f10996326c8ee770ba78c8d3c030e36d42"}
Jul 21 16:28:24.178882 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:24.178827    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sz6f7" event={"ID":"dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a","Type":"ContainerStarted","Data":"5d741ab3a2e794d02b0eb8da58f6e7bb9936cb192cda2aaee93d8064f3b99c48"}
Jul 21 16:28:24.189357 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:24.188848    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-djsl8" event={"ID":"246b7811-ef94-4006-98dc-b74c5ae49d93","Type":"ContainerStarted","Data":"1802e244523d060a4008f3c6e89bd617607f28f3f41feb97f45aae7b65abf5ae"}
Jul 21 16:28:24.204738 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:24.204710    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-slxwg" event={"ID":"140d35fe-6c85-41d0-b3b4-4e44ebea0d80","Type":"ContainerStarted","Data":"2acb6bcadf3e8041d8d95d1f7358a8f2614b1ab12c6c6cb66108d668de3274be"}
Jul 21 16:28:25.213688 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:25.213648    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" event={"ID":"357c3a182bc51ecfdc27d1a423b3cb52","Type":"ContainerStarted","Data":"731a185e7b185f388ceec91e6db24b99fa4d06762edc5337f1262d89538f1f78"}
Jul 21 16:28:25.230144 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:25.229591    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-103.ec2.internal" podStartSLOduration=4.229557295 podStartE2EDuration="4.229557295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:24.185922741 +0000 UTC m=+4.582153527" watchObservedRunningTime="2026-07-21 16:28:25.229557295 +0000 UTC m=+5.625788082"
Jul 21 16:28:25.676122 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:25.676082    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:25.676321 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:25.676144    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwht5\" (UniqueName: \"kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5\") pod \"network-check-target-dqnr9\" (UID: \"40ee9f54-597c-4293-af7b-6790edde15f8\") " pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:25.676321 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:25.676175    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs\") pod \"network-metrics-daemon-fm4hg\" (UID: \"f999015a-d707-4f1f-9e86-a69a77ada0d0\") " pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:25.676450 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:25.676340    2524 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:25.676450 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:25.676407    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs podName:f999015a-d707-4f1f-9e86-a69a77ada0d0 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:29.676387336 +0000 UTC m=+10.072618102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs") pod "network-metrics-daemon-fm4hg" (UID: "f999015a-d707-4f1f-9e86-a69a77ada0d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:25.676912 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:25.676886    2524 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:25.677018 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:25.676951    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret podName:1be3dca0-631a-4ebd-9bfc-2cb14e931f47 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:29.67693261 +0000 UTC m=+10.073163373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret") pod "global-pull-secret-syncer-2fs5t" (UID: "1be3dca0-631a-4ebd-9bfc-2cb14e931f47") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:25.677097 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:25.677042    2524 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:28:25.677097 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:25.677057    2524 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:28:25.677097 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:25.677072    2524 projected.go:196] Error preparing data for projected volume kube-api-access-fwht5 for pod openshift-network-diagnostics/network-check-target-dqnr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:25.677242 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:25.677114    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5 podName:40ee9f54-597c-4293-af7b-6790edde15f8 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:29.677100361 +0000 UTC m=+10.073331123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fwht5" (UniqueName: "kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5") pod "network-check-target-dqnr9" (UID: "40ee9f54-597c-4293-af7b-6790edde15f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:26.057251 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:26.057214    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:26.057505 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:26.057356    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:26.057826 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:26.057806    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:26.057947 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:26.057923    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:26.058011 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:26.058003    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:26.058112 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:26.058092    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:28.055634 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:28.055603    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:28.055979 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:28.055728    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:28.056127 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:28.056107    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:28.056239 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:28.056215    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:28.056290 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:28.056276    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:28.056501 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:28.056345    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:29.709917 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:29.709877    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:29.710363 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:29.709931    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwht5\" (UniqueName: \"kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5\") pod \"network-check-target-dqnr9\" (UID: \"40ee9f54-597c-4293-af7b-6790edde15f8\") " pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:29.710363 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:29.709963    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs\") pod \"network-metrics-daemon-fm4hg\" (UID: \"f999015a-d707-4f1f-9e86-a69a77ada0d0\") " pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:29.710363 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:29.710163    2524 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:29.710363 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:29.710227    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs podName:f999015a-d707-4f1f-9e86-a69a77ada0d0 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:37.710206482 +0000 UTC m=+18.106437241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs") pod "network-metrics-daemon-fm4hg" (UID: "f999015a-d707-4f1f-9e86-a69a77ada0d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:29.710700 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:29.710682    2524 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:29.710761 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:29.710732    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret podName:1be3dca0-631a-4ebd-9bfc-2cb14e931f47 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:37.710720913 +0000 UTC m=+18.106951671 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret") pod "global-pull-secret-syncer-2fs5t" (UID: "1be3dca0-631a-4ebd-9bfc-2cb14e931f47") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:29.710816 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:29.710806    2524 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:28:29.710867 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:29.710826    2524 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:28:29.710867 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:29.710835    2524 projected.go:196] Error preparing data for projected volume kube-api-access-fwht5 for pod openshift-network-diagnostics/network-check-target-dqnr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:29.710931 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:29.710881    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5 podName:40ee9f54-597c-4293-af7b-6790edde15f8 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:37.710873356 +0000 UTC m=+18.107104114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fwht5" (UniqueName: "kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5") pod "network-check-target-dqnr9" (UID: "40ee9f54-597c-4293-af7b-6790edde15f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:30.054614 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:30.054579    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:30.054614 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:30.054595    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:30.055754 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:30.055720    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:30.056181 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:30.056157    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:30.056268 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:30.056221    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:30.056384 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:30.056331    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:32.055352 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:32.054674    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:32.055352 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:32.054815    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:32.055352 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:32.055096    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:32.055352 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:32.055193    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:32.055352 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:32.055246    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:32.055352 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:32.055319    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:34.054078 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:34.054046    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:34.054541 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:34.054045    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:34.054609 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:34.054561    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:34.054776 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:34.054742    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:34.054906 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:34.054881    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:34.055411 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:34.055388    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:36.054204 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:36.054168    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:36.054671 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:36.054168    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:36.054671 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:36.054309    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:36.054671 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:36.054376    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:36.054671 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:36.054185    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:36.054671 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:36.054449    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:37.766899 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:37.766867    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:37.766899 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:37.766903    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwht5\" (UniqueName: \"kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5\") pod \"network-check-target-dqnr9\" (UID: \"40ee9f54-597c-4293-af7b-6790edde15f8\") " pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:37.767319 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:37.766922    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs\") pod \"network-metrics-daemon-fm4hg\" (UID: \"f999015a-d707-4f1f-9e86-a69a77ada0d0\") " pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:37.767319 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:37.767029    2524 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:37.767319 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:37.767029    2524 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:37.767319 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:37.767047    2524 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:28:37.767319 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:37.767066    2524 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:28:37.767319 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:37.767078    2524 projected.go:196] Error preparing data for projected volume kube-api-access-fwht5 for pod openshift-network-diagnostics/network-check-target-dqnr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:37.767319 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:37.767097    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs podName:f999015a-d707-4f1f-9e86-a69a77ada0d0 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:53.767078763 +0000 UTC m=+34.163309526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs") pod "network-metrics-daemon-fm4hg" (UID: "f999015a-d707-4f1f-9e86-a69a77ada0d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:37.767319 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:37.767117    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5 podName:40ee9f54-597c-4293-af7b-6790edde15f8 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:53.767105724 +0000 UTC m=+34.163336482 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fwht5" (UniqueName: "kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5") pod "network-check-target-dqnr9" (UID: "40ee9f54-597c-4293-af7b-6790edde15f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:37.767319 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:37.767131    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret podName:1be3dca0-631a-4ebd-9bfc-2cb14e931f47 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:53.767124958 +0000 UTC m=+34.163355717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret") pod "global-pull-secret-syncer-2fs5t" (UID: "1be3dca0-631a-4ebd-9bfc-2cb14e931f47") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:38.054342 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:38.054318    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:38.054342 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:38.054329    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:38.054466 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:38.054429    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:38.054530 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:38.054478    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:38.054590 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:38.054568    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:38.054698 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:38.054679    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:40.054987 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:40.054590    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:40.054987 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:40.054680    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:40.054987 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:40.054678    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:40.054987 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:40.054794    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:40.054987 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:40.054843    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:40.054987 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:40.054931    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:42.054544 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:42.054497    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:42.055028 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:42.054501    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:42.055028 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:42.054648    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:42.055028 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:42.054501    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:42.055028 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:42.054712    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:42.055028 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:42.054783    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:43.251876 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.251450    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g4bgp" event={"ID":"13f10258-5610-4e94-b3b8-edbabda5ad24","Type":"ContainerStarted","Data":"87d5ed88776141781cd18fb08f197e3cbc6c50d2fa64e80362fa7ef76b86a7eb"}
Jul 21 16:28:43.253174 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.253147    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8" event={"ID":"373465c7-9017-4c06-92b2-47a673d8ecfc","Type":"ContainerStarted","Data":"1f88b87f9b3c49001b0608790c68d2b05daf362ad5fbe9bca546cf585b63084c"}
Jul 21 16:28:43.254629 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.254555    2524 generic.go:356] "Generic (PLEG): container finished" podID="76e0f479-501e-44c3-a0fe-fb743653ffd9" containerID="10636528bb398043983a102ca51ef5249202e290c9f69898ff554f3d18feba23" exitCode=0
Jul 21 16:28:43.254744 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.254630    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnkqd" event={"ID":"76e0f479-501e-44c3-a0fe-fb743653ffd9","Type":"ContainerDied","Data":"10636528bb398043983a102ca51ef5249202e290c9f69898ff554f3d18feba23"}
Jul 21 16:28:43.256394 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.256376    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sz6f7" event={"ID":"dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a","Type":"ContainerStarted","Data":"77a963ff90a8da22bf9d605fc93c1d913b17e181144a3d4da811e4e27eaf83b0"}
Jul 21 16:28:43.257957 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.257902    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-slxwg" event={"ID":"140d35fe-6c85-41d0-b3b4-4e44ebea0d80","Type":"ContainerStarted","Data":"83336fc854fccbec718fa4e775069e969b2bd26921c5714e55f3db13ac0c6714"}
Jul 21 16:28:43.261530 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.261386    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fsdc4" event={"ID":"e501c98a-cee2-4fcd-a73f-17833cd531f8","Type":"ContainerStarted","Data":"617e654cd61b5d9a5b8d84c8525d5357b5200369b388449b2e8299b326babfb4"}
Jul 21 16:28:43.262870 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.262849    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-59jlc" event={"ID":"d3d7d75b-ca1e-415a-85ef-83492a25da93","Type":"ContainerStarted","Data":"b2a60b374d48426fe725bb742b505aea405f4c100d796b970c400a31adb91873"}
Jul 21 16:28:43.266078 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.266060    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l" event={"ID":"21a141c5-caee-4617-9653-0ce807c62883","Type":"ContainerStarted","Data":"42845c2ff372730ad7c4364d2f52e1b0f7087c39563cf141f66d14602bafc38d"}
Jul 21 16:28:43.266175 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.266127    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l" event={"ID":"21a141c5-caee-4617-9653-0ce807c62883","Type":"ContainerStarted","Data":"94f2152b0c03bb85c914623107141f25f7d4b4f155c316e1f88c3b8e22e0faeb"}
Jul 21 16:28:43.266235 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.266182    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l" event={"ID":"21a141c5-caee-4617-9653-0ce807c62883","Type":"ContainerStarted","Data":"9c4cec42538892491091dcd8b4d86ef9ebac6a37bd952f28ec3df43f8a03f8bb"}
Jul 21 16:28:43.266235 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.266230    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l" event={"ID":"21a141c5-caee-4617-9653-0ce807c62883","Type":"ContainerStarted","Data":"e35c0d3ab4bc4739c67ba63ee9a088a2827e5a527ead064e3c6cb26d5c57d4e3"}
Jul 21 16:28:43.266335 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.266277    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l" event={"ID":"21a141c5-caee-4617-9653-0ce807c62883","Type":"ContainerStarted","Data":"b957e3d4501ce5ba35723b0e48d51f807e8d676001885fc26ef9619e6a34d732"}
Jul 21 16:28:43.266335 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.266325    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l" event={"ID":"21a141c5-caee-4617-9653-0ce807c62883","Type":"ContainerStarted","Data":"13920f411714d97d47d256dac68bfa11a6c6da20b8576a4a2cd0b92713a8bf06"}
Jul 21 16:28:43.273916 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.273873    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-103.ec2.internal" podStartSLOduration=22.273862164 podStartE2EDuration="22.273862164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:25.230476798 +0000 UTC m=+5.626707582" watchObservedRunningTime="2026-07-21 16:28:43.273862164 +0000 UTC m=+23.670092945"
Jul 21 16:28:43.274388 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.274353    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g4bgp" podStartSLOduration=4.114851321 podStartE2EDuration="23.274340583s" totalImagesPullingTime="19.159489262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:43.274001195 +0000 UTC m=+23.670231964" watchObservedRunningTime="2026-07-21 16:28:43.274340583 +0000 UTC m=+23.670571362"
Jul 21 16:28:43.288281 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.288249    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fsdc4" podStartSLOduration=4.153131638 podStartE2EDuration="23.288232139s" totalImagesPullingTime="19.135100501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:43.28785063 +0000 UTC m=+23.684081412" watchObservedRunningTime="2026-07-21 16:28:43.288232139 +0000 UTC m=+23.684463000"
Jul 21 16:28:43.323658 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.323622    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-slxwg" podStartSLOduration=4.213562766 podStartE2EDuration="23.32361012s" totalImagesPullingTime="19.110047354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:43.323205475 +0000 UTC m=+23.719436256" watchObservedRunningTime="2026-07-21 16:28:43.32361012 +0000 UTC m=+23.719840900"
Jul 21 16:28:43.337817 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.337782    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sz6f7" podStartSLOduration=4.232661192 podStartE2EDuration="23.337771709s" totalImagesPullingTime="19.105110517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:43.337735899 +0000 UTC m=+23.733966689" watchObservedRunningTime="2026-07-21 16:28:43.337771709 +0000 UTC m=+23.734002488"
Jul 21 16:28:43.357053 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.357012    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-59jlc" podStartSLOduration=4.220757784 podStartE2EDuration="23.356999601s" totalImagesPullingTime="19.136241817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:43.356375054 +0000 UTC m=+23.752605835" watchObservedRunningTime="2026-07-21 16:28:43.356999601 +0000 UTC m=+23.753230380"
Jul 21 16:28:43.780068 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:43.780048    2524 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 16:28:44.003841 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:44.003707    2524 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T16:28:43.780064803Z","UUID":"7875306a-076e-47db-b270-7c647e54077e","Handler":null,"Name":"","Endpoint":""}
Jul 21 16:28:44.005530 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:44.005494    2524 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 16:28:44.005651 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:44.005552    2524 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 16:28:44.054663 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:44.054637    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:44.054663 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:44.054660    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:44.054894 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:44.054664    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:44.054894 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:44.054721    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:44.054894 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:44.054863    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:44.054998 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:44.054974    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:44.270418 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:44.270384    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-djsl8" event={"ID":"246b7811-ef94-4006-98dc-b74c5ae49d93","Type":"ContainerStarted","Data":"c557c68b9e64a532b94ad503992c931df27246b330950aa287e973c492d70df0"}
Jul 21 16:28:44.272588 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:44.272557    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8" event={"ID":"373465c7-9017-4c06-92b2-47a673d8ecfc","Type":"ContainerStarted","Data":"1ea5d4e388ef7a70d2ee950a972f17ea0df9aff1c6ef53bd75036c1511c35ff5"}
Jul 21 16:28:45.018275 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:45.018251    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fsdc4"
Jul 21 16:28:45.018851 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:45.018830    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fsdc4"
Jul 21 16:28:45.035146 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:45.035107    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-djsl8" podStartSLOduration=5.9146229 podStartE2EDuration="25.035092566s" totalImagesPullingTime="19.120469666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:44.285202676 +0000 UTC m=+24.681433468" watchObservedRunningTime="2026-07-21 16:28:45.035092566 +0000 UTC m=+25.431323346"
Jul 21 16:28:45.276995 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:45.276798    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8" event={"ID":"373465c7-9017-4c06-92b2-47a673d8ecfc","Type":"ContainerStarted","Data":"a384954dc281aecf49ab84606f8f8f2ee0c9ae09a947ddc65afeaace5c324465"}
Jul 21 16:28:45.280585 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:45.280481    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l" event={"ID":"21a141c5-caee-4617-9653-0ce807c62883","Type":"ContainerStarted","Data":"8ba6bf6c2b70a308baea4a446ff82ac25d7a2c2d2cc493f15154e34baded878c"}
Jul 21 16:28:45.280847 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:45.280812    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fsdc4"
Jul 21 16:28:45.281410 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:45.281390    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fsdc4"
Jul 21 16:28:45.311105 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:45.311066    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-52lq8" podStartSLOduration=3.944944065 podStartE2EDuration="25.311052753s" totalImagesPullingTime="21.366108688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:28:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:45.295485954 +0000 UTC m=+25.691716733" watchObservedRunningTime="2026-07-21 16:28:45.311052753 +0000 UTC m=+25.707283532"
Jul 21 16:28:46.054286 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:46.054257    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:46.054488 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:46.054281    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:46.054488 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:46.054349    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:46.054488 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:46.054370    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:46.054488 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:46.054455    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:46.054737 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:46.054561    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:47.481546 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:47.481463    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sz6f7_dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a/dns-node-resolver/0.log"
Jul 21 16:28:48.054799 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:48.054560    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:48.054799 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:48.054696    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:48.055097 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:48.054696    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:48.055097 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:48.054867    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:48.055097 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:48.054942    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:48.055097 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:48.055022    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:48.292222 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:48.291557    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l" event={"ID":"21a141c5-caee-4617-9653-0ce807c62883","Type":"ContainerStarted","Data":"a6647616fb032e5398b747a1b00b4d82d50254f5cdb1d58c475cccba756de381"}
Jul 21 16:28:48.292222 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:48.291942    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:48.293525 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:48.293480    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnkqd" event={"ID":"76e0f479-501e-44c3-a0fe-fb743653ffd9","Type":"ContainerStarted","Data":"2fda4fca20cde84c2058f1fa8c4de129d3d9cfb3761cefc3745a79a122cc7f1a"}
Jul 21 16:28:48.307636 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:48.307620    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:48.320062 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:48.320012    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l" podStartSLOduration=9.072961203 podStartE2EDuration="28.319994614s" totalImagesPullingTime="19.247033411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:48.318171548 +0000 UTC m=+28.714402327" watchObservedRunningTime="2026-07-21 16:28:48.319994614 +0000 UTC m=+28.716225396"
Jul 21 16:28:48.457740 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:48.457716    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-slxwg_140d35fe-6c85-41d0-b3b4-4e44ebea0d80/node-ca/0.log"
Jul 21 16:28:49.297224 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:49.297184    2524 generic.go:356] "Generic (PLEG): container finished" podID="76e0f479-501e-44c3-a0fe-fb743653ffd9" containerID="2fda4fca20cde84c2058f1fa8c4de129d3d9cfb3761cefc3745a79a122cc7f1a" exitCode=0
Jul 21 16:28:49.298010 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:49.297257    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnkqd" event={"ID":"76e0f479-501e-44c3-a0fe-fb743653ffd9","Type":"ContainerDied","Data":"2fda4fca20cde84c2058f1fa8c4de129d3d9cfb3761cefc3745a79a122cc7f1a"}
Jul 21 16:28:49.298010 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:49.297660    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:49.298010 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:49.297733    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:49.312251 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:49.312230    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:28:50.054964 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:50.054938    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:50.055090 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:50.055037    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:50.055090 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:50.055047    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:50.055200 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:50.055137    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:50.055200 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:50.055190    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:50.055314 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:50.055295    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:50.208889 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:50.208860    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2fs5t"]
Jul 21 16:28:50.211644 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:50.211620    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqnr9"]
Jul 21 16:28:50.212317 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:50.212295    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fm4hg"]
Jul 21 16:28:50.299467 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:50.299443    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:50.299467 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:50.299453    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:50.299467 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:50.299465    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:50.299860 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:50.299544    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:50.299860 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:50.299611    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:50.300018 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:50.299995    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:51.303317 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:51.303282    2524 generic.go:356] "Generic (PLEG): container finished" podID="76e0f479-501e-44c3-a0fe-fb743653ffd9" containerID="65cc66d5f7cce664f538f0c75d5737b9b2d82784d764cd81ea4d6108eb492ae1" exitCode=0
Jul 21 16:28:51.303745 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:51.303366    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnkqd" event={"ID":"76e0f479-501e-44c3-a0fe-fb743653ffd9","Type":"ContainerDied","Data":"65cc66d5f7cce664f538f0c75d5737b9b2d82784d764cd81ea4d6108eb492ae1"}
Jul 21 16:28:52.054496 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:52.054468    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:52.054680 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:52.054470    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:52.054680 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:52.054580    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:52.054680 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:52.054478    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:52.054680 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:52.054627    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:52.054894 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:52.054722    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:53.309962 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:53.309926    2524 generic.go:356] "Generic (PLEG): container finished" podID="76e0f479-501e-44c3-a0fe-fb743653ffd9" containerID="0cadaed735912e3e672d6cea1665786a6e7943c3602ff7c95946f63a1b9d733c" exitCode=0
Jul 21 16:28:53.310438 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:53.309976    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnkqd" event={"ID":"76e0f479-501e-44c3-a0fe-fb743653ffd9","Type":"ContainerDied","Data":"0cadaed735912e3e672d6cea1665786a6e7943c3602ff7c95946f63a1b9d733c"}
Jul 21 16:28:53.786956 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:53.786926    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:53.786956 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:53.786959    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwht5\" (UniqueName: \"kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5\") pod \"network-check-target-dqnr9\" (UID: \"40ee9f54-597c-4293-af7b-6790edde15f8\") " pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:53.787129 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:53.786977    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs\") pod \"network-metrics-daemon-fm4hg\" (UID: \"f999015a-d707-4f1f-9e86-a69a77ada0d0\") " pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:53.787129 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:53.787067    2524 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:53.787129 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:53.787068    2524 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:53.787129 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:53.787081    2524 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:28:53.787129 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:53.787098    2524 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:28:53.787129 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:53.787108    2524 projected.go:196] Error preparing data for projected volume kube-api-access-fwht5 for pod openshift-network-diagnostics/network-check-target-dqnr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:53.787129 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:53.787122    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret podName:1be3dca0-631a-4ebd-9bfc-2cb14e931f47 nodeName:}" failed. No retries permitted until 2026-07-21 16:29:25.78710287 +0000 UTC m=+66.183333628 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret") pod "global-pull-secret-syncer-2fs5t" (UID: "1be3dca0-631a-4ebd-9bfc-2cb14e931f47") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:28:53.787340 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:53.787143    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs podName:f999015a-d707-4f1f-9e86-a69a77ada0d0 nodeName:}" failed. No retries permitted until 2026-07-21 16:29:25.7871359 +0000 UTC m=+66.183366660 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs") pod "network-metrics-daemon-fm4hg" (UID: "f999015a-d707-4f1f-9e86-a69a77ada0d0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:28:53.787340 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:53.787159    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5 podName:40ee9f54-597c-4293-af7b-6790edde15f8 nodeName:}" failed. No retries permitted until 2026-07-21 16:29:25.787152246 +0000 UTC m=+66.183383005 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fwht5" (UniqueName: "kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5") pod "network-check-target-dqnr9" (UID: "40ee9f54-597c-4293-af7b-6790edde15f8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:28:54.054236 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:54.054145    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:54.054236 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:54.054162    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:54.054236 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:54.054177    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:54.054467 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:54.054375    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:54.054467 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:54.054397    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:54.054591 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:54.054475    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:56.054449 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:56.054414    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:56.055037 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:56.054414    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:56.055037 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:56.054556    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:56.055037 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:56.054610    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:56.055037 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:56.054682    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:56.055037 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:56.054757    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:58.053776 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:58.053746    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:28:58.054220 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:58.053755    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:28:58.054220 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:58.053843    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:28:58.054220 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:58.053756    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:28:58.054220 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:58.053907    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:28:58.054220 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:28:58.053995    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:28:58.323160 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:58.323083    2524 generic.go:356] "Generic (PLEG): container finished" podID="76e0f479-501e-44c3-a0fe-fb743653ffd9" containerID="9d8e08499fa43ef79dd1c28d6fb9a443bfb4d7e53652e23657c8fd52f3a1178c" exitCode=0
Jul 21 16:28:58.323160 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:58.323143    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnkqd" event={"ID":"76e0f479-501e-44c3-a0fe-fb743653ffd9","Type":"ContainerDied","Data":"9d8e08499fa43ef79dd1c28d6fb9a443bfb4d7e53652e23657c8fd52f3a1178c"}
Jul 21 16:28:59.328870 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:59.328838    2524 generic.go:356] "Generic (PLEG): container finished" podID="76e0f479-501e-44c3-a0fe-fb743653ffd9" containerID="b9ff8a6736da42a9edbdce061c639d99fe5d68a8c2e924ff471cdb5ff65323a0" exitCode=0
Jul 21 16:28:59.329328 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:28:59.328884    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnkqd" event={"ID":"76e0f479-501e-44c3-a0fe-fb743653ffd9","Type":"ContainerDied","Data":"b9ff8a6736da42a9edbdce061c639d99fe5d68a8c2e924ff471cdb5ff65323a0"}
Jul 21 16:29:00.055146 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:00.054985    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:29:00.055315 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:00.055053    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:29:00.055315 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:00.055211    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:29:00.055315 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:00.055302    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:29:00.055485 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:00.055075    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:29:00.055485 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:00.055402    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:29:00.334158 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:00.334075    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnkqd" event={"ID":"76e0f479-501e-44c3-a0fe-fb743653ffd9","Type":"ContainerStarted","Data":"8834b8c625446c62165ad1432d02fe1cf65f82720d5afb4bc294f185807eee37"}
Jul 21 16:29:00.361077 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:00.361032    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hnkqd" podStartSLOduration=9.455332814 podStartE2EDuration="40.361019496s" totalImagesPullingTime="30.905686682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:28:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:00.359482997 +0000 UTC m=+40.755713791" watchObservedRunningTime="2026-07-21 16:29:00.361019496 +0000 UTC m=+40.757250276"
Jul 21 16:29:02.054309 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:02.054273    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:29:02.054776 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:02.054340    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:29:02.054776 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:02.054345    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:29:02.054776 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:02.054433    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:29:02.054776 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:02.054489    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:29:02.054776 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:02.054592    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:29:04.056762 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:04.056730    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:29:04.056762 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:04.056764    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:29:04.056762 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:04.056765    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:29:04.057221 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:04.056846    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:29:04.057221 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:04.056965    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:29:04.057221 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:04.057006    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:29:06.057426 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:06.057397    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:29:06.057880 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:06.057397    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:29:06.057880 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:06.057501    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:29:06.057880 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:06.057397    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:29:06.057880 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:06.057602    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:29:06.057880 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:06.057642    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:29:08.054652 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:08.054612    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:29:08.054652 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:08.054635    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:29:08.055262 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:08.054612    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:29:08.055262 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:08.054715    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2fs5t" podUID="1be3dca0-631a-4ebd-9bfc-2cb14e931f47"
Jul 21 16:29:08.055262 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:08.054835    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fm4hg" podUID="f999015a-d707-4f1f-9e86-a69a77ada0d0"
Jul 21 16:29:08.055262 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:08.054887    2524 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqnr9" podUID="40ee9f54-597c-4293-af7b-6790edde15f8"
Jul 21 16:29:09.901273 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.901242    2524 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-103.ec2.internal" event="NodeReady"
Jul 21 16:29:09.901748 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.901390    2524 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 16:29:09.951018 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.950983    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68f6f659cb-b5g7v"]
Jul 21 16:29:09.965412 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.965384    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:09.967597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.967570    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6bkwr"]
Jul 21 16:29:09.968708 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.968666    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 16:29:09.968853 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.968813    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zkh7z\""
Jul 21 16:29:09.968992 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.968973    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 16:29:09.969283 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.969253    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 16:29:09.973864 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.973841    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 16:29:09.983954 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.983920    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68f6f659cb-b5g7v"]
Jul 21 16:29:09.984071 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.983969    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rkgrw"]
Jul 21 16:29:09.984071 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.984027    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:09.986626 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.986598    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 16:29:09.986761 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.986635    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 16:29:09.987383 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.987362    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d444m\""
Jul 21 16:29:09.987654 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.987640    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 16:29:09.987865 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:09.987839    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 16:29:10.005104 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.005070    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6bkwr"]
Jul 21 16:29:10.005104 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.005112    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rkgrw"]
Jul 21 16:29:10.005312 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.005217    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:10.007595 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.007576    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 16:29:10.007817 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.007801    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 16:29:10.007896 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.007863    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5fjqx\""
Jul 21 16:29:10.054803 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.054704    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:29:10.054971 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.054942    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:29:10.055204 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.055100    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:29:10.057478 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.057457    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 16:29:10.057611 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.057456    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dnpg8\""
Jul 21 16:29:10.057676 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.057649    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 16:29:10.057748 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.057729    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 16:29:10.057909 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.057893    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 16:29:10.057978 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.057894    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xlxp4\""
Jul 21 16:29:10.066196 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.066171    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k8552"]
Jul 21 16:29:10.082620 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.082591    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k8552"]
Jul 21 16:29:10.082724 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.082681    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k8552"
Jul 21 16:29:10.085138 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.085119    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 16:29:10.085283 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.085265    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 16:29:10.085360 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.085273    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c76lp\""
Jul 21 16:29:10.085402 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.085370    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 16:29:10.100054 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100030    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkj4l\" (UniqueName: \"kubernetes.io/projected/9feaa7dd-98c6-430c-9baf-67c598074c1c-kube-api-access-wkj4l\") pod \"dns-default-rkgrw\" (UID: \"9feaa7dd-98c6-430c-9baf-67c598074c1c\") " pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:10.100175 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100096    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/543ee99f-0626-4462-912d-8d8e781ee332-image-registry-private-configuration\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.100175 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100142    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/543ee99f-0626-4462-912d-8d8e781ee332-registry-certificates\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.100288 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100174    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/543ee99f-0626-4462-912d-8d8e781ee332-installation-pull-secrets\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.100288 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100234    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/543ee99f-0626-4462-912d-8d8e781ee332-ca-trust-extracted\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.100288 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100267    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/543ee99f-0626-4462-912d-8d8e781ee332-bound-sa-token\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.100433 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100293    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/05e4d52b-67ba-453e-ad27-529cd7fe7a20-crio-socket\") pod \"insights-runtime-extractor-6bkwr\" (UID: \"05e4d52b-67ba-453e-ad27-529cd7fe7a20\") " pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.100433 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100330    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9feaa7dd-98c6-430c-9baf-67c598074c1c-metrics-tls\") pod \"dns-default-rkgrw\" (UID: \"9feaa7dd-98c6-430c-9baf-67c598074c1c\") " pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:10.100433 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100358    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/05e4d52b-67ba-453e-ad27-529cd7fe7a20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bkwr\" (UID: \"05e4d52b-67ba-453e-ad27-529cd7fe7a20\") " pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.100433 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100395    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/05e4d52b-67ba-453e-ad27-529cd7fe7a20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bkwr\" (UID: \"05e4d52b-67ba-453e-ad27-529cd7fe7a20\") " pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.100651 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100432    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/543ee99f-0626-4462-912d-8d8e781ee332-trusted-ca\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.100651 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100455    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9feaa7dd-98c6-430c-9baf-67c598074c1c-tmp-dir\") pod \"dns-default-rkgrw\" (UID: \"9feaa7dd-98c6-430c-9baf-67c598074c1c\") " pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:10.100651 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100487    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/543ee99f-0626-4462-912d-8d8e781ee332-registry-tls\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.100651 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100530    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47zcq\" (UniqueName: \"kubernetes.io/projected/543ee99f-0626-4462-912d-8d8e781ee332-kube-api-access-47zcq\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.100651 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100561    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22ppb\" (UniqueName: \"kubernetes.io/projected/05e4d52b-67ba-453e-ad27-529cd7fe7a20-kube-api-access-22ppb\") pod \"insights-runtime-extractor-6bkwr\" (UID: \"05e4d52b-67ba-453e-ad27-529cd7fe7a20\") " pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.100651 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100588    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/05e4d52b-67ba-453e-ad27-529cd7fe7a20-data-volume\") pod \"insights-runtime-extractor-6bkwr\" (UID: \"05e4d52b-67ba-453e-ad27-529cd7fe7a20\") " pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.100651 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.100609    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9feaa7dd-98c6-430c-9baf-67c598074c1c-config-volume\") pod \"dns-default-rkgrw\" (UID: \"9feaa7dd-98c6-430c-9baf-67c598074c1c\") " pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:10.201560 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.201501    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9feaa7dd-98c6-430c-9baf-67c598074c1c-metrics-tls\") pod \"dns-default-rkgrw\" (UID: \"9feaa7dd-98c6-430c-9baf-67c598074c1c\") " pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:10.201759 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.201569    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/05e4d52b-67ba-453e-ad27-529cd7fe7a20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bkwr\" (UID: \"05e4d52b-67ba-453e-ad27-529cd7fe7a20\") " pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.201759 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.201595    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/05e4d52b-67ba-453e-ad27-529cd7fe7a20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bkwr\" (UID: \"05e4d52b-67ba-453e-ad27-529cd7fe7a20\") " pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.201759 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.201616    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc-cert\") pod \"ingress-canary-k8552\" (UID: \"c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc\") " pod="openshift-ingress-canary/ingress-canary-k8552"
Jul 21 16:29:10.201759 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.201635    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/543ee99f-0626-4462-912d-8d8e781ee332-trusted-ca\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.201759 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.201657    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9feaa7dd-98c6-430c-9baf-67c598074c1c-tmp-dir\") pod \"dns-default-rkgrw\" (UID: \"9feaa7dd-98c6-430c-9baf-67c598074c1c\") " pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:10.201759 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.201689    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/543ee99f-0626-4462-912d-8d8e781ee332-registry-tls\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.201759 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.201717    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47zcq\" (UniqueName: \"kubernetes.io/projected/543ee99f-0626-4462-912d-8d8e781ee332-kube-api-access-47zcq\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.202115 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.201763    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22ppb\" (UniqueName: \"kubernetes.io/projected/05e4d52b-67ba-453e-ad27-529cd7fe7a20-kube-api-access-22ppb\") pod \"insights-runtime-extractor-6bkwr\" (UID: \"05e4d52b-67ba-453e-ad27-529cd7fe7a20\") " pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.202115 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.201792    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/05e4d52b-67ba-453e-ad27-529cd7fe7a20-data-volume\") pod \"insights-runtime-extractor-6bkwr\" (UID: \"05e4d52b-67ba-453e-ad27-529cd7fe7a20\") " pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.202115 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.201817    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9feaa7dd-98c6-430c-9baf-67c598074c1c-config-volume\") pod \"dns-default-rkgrw\" (UID: \"9feaa7dd-98c6-430c-9baf-67c598074c1c\") " pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:10.202115 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.201841    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w9jd\" (UniqueName: \"kubernetes.io/projected/c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc-kube-api-access-4w9jd\") pod \"ingress-canary-k8552\" (UID: \"c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc\") " pod="openshift-ingress-canary/ingress-canary-k8552"
Jul 21 16:29:10.202115 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.201870    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkj4l\" (UniqueName: \"kubernetes.io/projected/9feaa7dd-98c6-430c-9baf-67c598074c1c-kube-api-access-wkj4l\") pod \"dns-default-rkgrw\" (UID: \"9feaa7dd-98c6-430c-9baf-67c598074c1c\") " pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:10.202115 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.201956    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/543ee99f-0626-4462-912d-8d8e781ee332-image-registry-private-configuration\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.202115 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.201986    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/543ee99f-0626-4462-912d-8d8e781ee332-registry-certificates\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.202115 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.202011    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/543ee99f-0626-4462-912d-8d8e781ee332-installation-pull-secrets\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.202115 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.202039    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/543ee99f-0626-4462-912d-8d8e781ee332-ca-trust-extracted\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.202115 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.202064    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/543ee99f-0626-4462-912d-8d8e781ee332-bound-sa-token\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.202115 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.202103    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9feaa7dd-98c6-430c-9baf-67c598074c1c-tmp-dir\") pod \"dns-default-rkgrw\" (UID: \"9feaa7dd-98c6-430c-9baf-67c598074c1c\") " pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:10.202623 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.202253    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/05e4d52b-67ba-453e-ad27-529cd7fe7a20-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6bkwr\" (UID: \"05e4d52b-67ba-453e-ad27-529cd7fe7a20\") " pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.202623 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.202486    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/05e4d52b-67ba-453e-ad27-529cd7fe7a20-data-volume\") pod \"insights-runtime-extractor-6bkwr\" (UID: \"05e4d52b-67ba-453e-ad27-529cd7fe7a20\") " pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.202623 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.202584    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/543ee99f-0626-4462-912d-8d8e781ee332-ca-trust-extracted\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.202803 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.202780    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/543ee99f-0626-4462-912d-8d8e781ee332-trusted-ca\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.203206 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.203175    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/05e4d52b-67ba-453e-ad27-529cd7fe7a20-crio-socket\") pod \"insights-runtime-extractor-6bkwr\" (UID: \"05e4d52b-67ba-453e-ad27-529cd7fe7a20\") " pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.203361 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.203335    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/05e4d52b-67ba-453e-ad27-529cd7fe7a20-crio-socket\") pod \"insights-runtime-extractor-6bkwr\" (UID: \"05e4d52b-67ba-453e-ad27-529cd7fe7a20\") " pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.203438 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.203422    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/543ee99f-0626-4462-912d-8d8e781ee332-registry-certificates\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.206016 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.205987    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9feaa7dd-98c6-430c-9baf-67c598074c1c-metrics-tls\") pod \"dns-default-rkgrw\" (UID: \"9feaa7dd-98c6-430c-9baf-67c598074c1c\") " pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:10.206106 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.206090    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/543ee99f-0626-4462-912d-8d8e781ee332-image-registry-private-configuration\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.206150 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.206112    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/05e4d52b-67ba-453e-ad27-529cd7fe7a20-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6bkwr\" (UID: \"05e4d52b-67ba-453e-ad27-529cd7fe7a20\") " pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.206258 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.206237    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/543ee99f-0626-4462-912d-8d8e781ee332-installation-pull-secrets\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.206314 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.206297    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/543ee99f-0626-4462-912d-8d8e781ee332-registry-tls\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.207460 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.207444    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9feaa7dd-98c6-430c-9baf-67c598074c1c-config-volume\") pod \"dns-default-rkgrw\" (UID: \"9feaa7dd-98c6-430c-9baf-67c598074c1c\") " pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:10.209899 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.209870    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/543ee99f-0626-4462-912d-8d8e781ee332-bound-sa-token\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.210230 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.210211    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47zcq\" (UniqueName: \"kubernetes.io/projected/543ee99f-0626-4462-912d-8d8e781ee332-kube-api-access-47zcq\") pod \"image-registry-68f6f659cb-b5g7v\" (UID: \"543ee99f-0626-4462-912d-8d8e781ee332\") " pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.210287 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.210262    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkj4l\" (UniqueName: \"kubernetes.io/projected/9feaa7dd-98c6-430c-9baf-67c598074c1c-kube-api-access-wkj4l\") pod \"dns-default-rkgrw\" (UID: \"9feaa7dd-98c6-430c-9baf-67c598074c1c\") " pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:10.211103 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.211084    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22ppb\" (UniqueName: \"kubernetes.io/projected/05e4d52b-67ba-453e-ad27-529cd7fe7a20-kube-api-access-22ppb\") pod \"insights-runtime-extractor-6bkwr\" (UID: \"05e4d52b-67ba-453e-ad27-529cd7fe7a20\") " pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.276166 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.276131    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:10.294282 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.294251    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6bkwr"
Jul 21 16:29:10.304032 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.304007    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w9jd\" (UniqueName: \"kubernetes.io/projected/c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc-kube-api-access-4w9jd\") pod \"ingress-canary-k8552\" (UID: \"c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc\") " pod="openshift-ingress-canary/ingress-canary-k8552"
Jul 21 16:29:10.304150 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.304133    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc-cert\") pod \"ingress-canary-k8552\" (UID: \"c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc\") " pod="openshift-ingress-canary/ingress-canary-k8552"
Jul 21 16:29:10.306933 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.306910    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc-cert\") pod \"ingress-canary-k8552\" (UID: \"c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc\") " pod="openshift-ingress-canary/ingress-canary-k8552"
Jul 21 16:29:10.312174 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.312154    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w9jd\" (UniqueName: \"kubernetes.io/projected/c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc-kube-api-access-4w9jd\") pod \"ingress-canary-k8552\" (UID: \"c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc\") " pod="openshift-ingress-canary/ingress-canary-k8552"
Jul 21 16:29:10.316786 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.316761    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:10.391692 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.390601    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k8552"
Jul 21 16:29:10.477908 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.477871    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6bkwr"]
Jul 21 16:29:10.485430 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.485239    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68f6f659cb-b5g7v"]
Jul 21 16:29:10.490726 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:29:10.490693    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543ee99f_0626_4462_912d_8d8e781ee332.slice/crio-bca4b80e0f6532cd1373621e6bf6c3feb019dc23306dd2e2e3e0f523ff9a6bee WatchSource:0}: Error finding container bca4b80e0f6532cd1373621e6bf6c3feb019dc23306dd2e2e3e0f523ff9a6bee: Status 404 returned error can't find the container with id bca4b80e0f6532cd1373621e6bf6c3feb019dc23306dd2e2e3e0f523ff9a6bee
Jul 21 16:29:10.504060 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.504028    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rkgrw"]
Jul 21 16:29:10.509651 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:29:10.509621    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9feaa7dd_98c6_430c_9baf_67c598074c1c.slice/crio-4c95106c0234b6b8c629b62a22426a46f1548dcbee46f6a93c1d48af5652bd7c WatchSource:0}: Error finding container 4c95106c0234b6b8c629b62a22426a46f1548dcbee46f6a93c1d48af5652bd7c: Status 404 returned error can't find the container with id 4c95106c0234b6b8c629b62a22426a46f1548dcbee46f6a93c1d48af5652bd7c
Jul 21 16:29:10.553036 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:10.553008    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k8552"]
Jul 21 16:29:10.558447 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:29:10.558420    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b0c197_d85d_4b81_8fdb_9c2fa1d808bc.slice/crio-267975183e2fc1397e989ee7c751a7cd11faf71cb23fe21be994c29bf534ad0f WatchSource:0}: Error finding container 267975183e2fc1397e989ee7c751a7cd11faf71cb23fe21be994c29bf534ad0f: Status 404 returned error can't find the container with id 267975183e2fc1397e989ee7c751a7cd11faf71cb23fe21be994c29bf534ad0f
Jul 21 16:29:11.367562 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:11.363764    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rkgrw" event={"ID":"9feaa7dd-98c6-430c-9baf-67c598074c1c","Type":"ContainerStarted","Data":"4c95106c0234b6b8c629b62a22426a46f1548dcbee46f6a93c1d48af5652bd7c"}
Jul 21 16:29:11.369809 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:11.369773    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bkwr" event={"ID":"05e4d52b-67ba-453e-ad27-529cd7fe7a20","Type":"ContainerStarted","Data":"21ebe77c95068daf1ec41ab9584c2fee2579b4856c660e0d3b6dcee34f91cd7f"}
Jul 21 16:29:11.372972 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:11.372939    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v" event={"ID":"543ee99f-0626-4462-912d-8d8e781ee332","Type":"ContainerStarted","Data":"6ae008700c97ad1e61493485e98649fa0c42ae2f8fc7c324cb3036af500d8937"}
Jul 21 16:29:11.373077 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:11.372992    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v" event={"ID":"543ee99f-0626-4462-912d-8d8e781ee332","Type":"ContainerStarted","Data":"bca4b80e0f6532cd1373621e6bf6c3feb019dc23306dd2e2e3e0f523ff9a6bee"}
Jul 21 16:29:11.373753 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:11.373732    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:11.376738 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:11.376704    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k8552" event={"ID":"c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc","Type":"ContainerStarted","Data":"267975183e2fc1397e989ee7c751a7cd11faf71cb23fe21be994c29bf534ad0f"}
Jul 21 16:29:11.394292 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:11.393939    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v" podStartSLOduration=2.393920396 podStartE2EDuration="2.393920396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:29:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:11.391357118 +0000 UTC m=+51.787587901" watchObservedRunningTime="2026-07-21 16:29:11.393920396 +0000 UTC m=+51.790151177"
Jul 21 16:29:13.385982 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:13.385929    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rkgrw" event={"ID":"9feaa7dd-98c6-430c-9baf-67c598074c1c","Type":"ContainerStarted","Data":"f4516d8786e3b49922845c7261e21154cb67b3cd563ca0c6e85583e66e724c7e"}
Jul 21 16:29:13.386382 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:13.386005    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rkgrw" event={"ID":"9feaa7dd-98c6-430c-9baf-67c598074c1c","Type":"ContainerStarted","Data":"b516c081eaa699cc6585be0d405ff3ac0ff6543f5a0f48c19cb15abe307bce60"}
Jul 21 16:29:13.405922 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:13.405871    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rkgrw" podStartSLOduration=2.015431339 podStartE2EDuration="4.405854698s" totalImagesPullingTime="2.390423359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:29:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:13.405139294 +0000 UTC m=+53.801370075" watchObservedRunningTime="2026-07-21 16:29:13.405854698 +0000 UTC m=+53.802085479"
Jul 21 16:29:14.388906 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:14.388867    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:17.397447 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:17.397396    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k8552" event={"ID":"c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc","Type":"ContainerStarted","Data":"9924f7a46eadc6f76d471715c024ca8795b2122037a925620bbd1d68bcedb292"}
Jul 21 16:29:17.398882 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:17.398850    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bkwr" event={"ID":"05e4d52b-67ba-453e-ad27-529cd7fe7a20","Type":"ContainerStarted","Data":"e34f48f9b01a48868300ae3aa83a1bbf74c79f54a171168dfd9e7aa844360d50"}
Jul 21 16:29:17.413698 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:17.413654    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k8552" podStartSLOduration=1.037926441 podStartE2EDuration="7.413640111s" totalImagesPullingTime="6.37571367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:17.41263122 +0000 UTC m=+57.808862001" watchObservedRunningTime="2026-07-21 16:29:17.413640111 +0000 UTC m=+57.809870870"
Jul 21 16:29:21.325385 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:21.325355    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hj27l"
Jul 21 16:29:21.412837 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:21.412804    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bkwr" event={"ID":"05e4d52b-67ba-453e-ad27-529cd7fe7a20","Type":"ContainerStarted","Data":"f5403ce4797621d839983678073e22e56f21d3099829bef02462c03fb10c1a32"}
Jul 21 16:29:24.392586 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:24.392557    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rkgrw"
Jul 21 16:29:24.426261 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:24.426190    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6bkwr" event={"ID":"05e4d52b-67ba-453e-ad27-529cd7fe7a20","Type":"ContainerStarted","Data":"fc5d0051ed51f95768e60ed3f32b7dab0724e6e47ac015ff6ade836aa4a9a87f"}
Jul 21 16:29:24.443214 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:24.443171    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6bkwr" podStartSLOduration=1.893595844 podStartE2EDuration="15.443153135s" totalImagesPullingTime="13.549557291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:29:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:24.442205489 +0000 UTC m=+64.838436269" watchObservedRunningTime="2026-07-21 16:29:24.443153135 +0000 UTC m=+64.839383916"
Jul 21 16:29:25.824358 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:25.824313    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:29:25.824358 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:25.824356    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwht5\" (UniqueName: \"kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5\") pod \"network-check-target-dqnr9\" (UID: \"40ee9f54-597c-4293-af7b-6790edde15f8\") " pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:29:25.824823 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:25.824379    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs\") pod \"network-metrics-daemon-fm4hg\" (UID: \"f999015a-d707-4f1f-9e86-a69a77ada0d0\") " pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:29:25.826984 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:25.826966    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 16:29:25.827980 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:25.827964    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 16:29:25.828228 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:25.828210    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 16:29:25.837086 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:25.837064    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 16:29:25.837357 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:25.837331    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f999015a-d707-4f1f-9e86-a69a77ada0d0-metrics-certs\") pod \"network-metrics-daemon-fm4hg\" (UID: \"f999015a-d707-4f1f-9e86-a69a77ada0d0\") " pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:29:25.837357 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:25.837350    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1be3dca0-631a-4ebd-9bfc-2cb14e931f47-original-pull-secret\") pod \"global-pull-secret-syncer-2fs5t\" (UID: \"1be3dca0-631a-4ebd-9bfc-2cb14e931f47\") " pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:29:25.848114 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:25.848089    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwht5\" (UniqueName: \"kubernetes.io/projected/40ee9f54-597c-4293-af7b-6790edde15f8-kube-api-access-fwht5\") pod \"network-check-target-dqnr9\" (UID: \"40ee9f54-597c-4293-af7b-6790edde15f8\") " pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:29:25.968090 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:25.968060    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dnpg8\""
Jul 21 16:29:25.973675 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:25.973653    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xlxp4\""
Jul 21 16:29:25.975346 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:25.975329    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2fs5t"
Jul 21 16:29:25.976410 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:25.976397    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:29:25.981420 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:25.981405    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fm4hg"
Jul 21 16:29:26.115495 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:26.115465    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqnr9"]
Jul 21 16:29:26.118062 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:29:26.118032    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ee9f54_597c_4293_af7b_6790edde15f8.slice/crio-8962123b75c3616d2d173c325f05c596595d25a361bd99ad817cbebe84f45f57 WatchSource:0}: Error finding container 8962123b75c3616d2d173c325f05c596595d25a361bd99ad817cbebe84f45f57: Status 404 returned error can't find the container with id 8962123b75c3616d2d173c325f05c596595d25a361bd99ad817cbebe84f45f57
Jul 21 16:29:26.341633 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:26.341547    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2fs5t"]
Jul 21 16:29:26.346769 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:26.345435    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fm4hg"]
Jul 21 16:29:26.349921 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:29:26.349733    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf999015a_d707_4f1f_9e86_a69a77ada0d0.slice/crio-f2707c4966b5b98744c4004555a83d09e20f757bac6d07e0c8419505ccaee69d WatchSource:0}: Error finding container f2707c4966b5b98744c4004555a83d09e20f757bac6d07e0c8419505ccaee69d: Status 404 returned error can't find the container with id f2707c4966b5b98744c4004555a83d09e20f757bac6d07e0c8419505ccaee69d
Jul 21 16:29:26.433161 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:26.433123    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2fs5t" event={"ID":"1be3dca0-631a-4ebd-9bfc-2cb14e931f47","Type":"ContainerStarted","Data":"bb9572c1173791b8285dd4972aa7758e2868d1a0b76d6c757e9553628466ff1d"}
Jul 21 16:29:26.434251 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:26.434231    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fm4hg" event={"ID":"f999015a-d707-4f1f-9e86-a69a77ada0d0","Type":"ContainerStarted","Data":"f2707c4966b5b98744c4004555a83d09e20f757bac6d07e0c8419505ccaee69d"}
Jul 21 16:29:26.435161 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:26.435143    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqnr9" event={"ID":"40ee9f54-597c-4293-af7b-6790edde15f8","Type":"ContainerStarted","Data":"8962123b75c3616d2d173c325f05c596595d25a361bd99ad817cbebe84f45f57"}
Jul 21 16:29:28.446541 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:28.446485    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fm4hg" event={"ID":"f999015a-d707-4f1f-9e86-a69a77ada0d0","Type":"ContainerStarted","Data":"44e22a559680f544a5d0f8fac36ef7c376f658a1718fedc635e9efda629c7309"}
Jul 21 16:29:28.446967 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:28.446571    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fm4hg" event={"ID":"f999015a-d707-4f1f-9e86-a69a77ada0d0","Type":"ContainerStarted","Data":"5bc7d2463c4961e0dfe1b1e3658f69fbe272c805a1572368bab364d3a1f22fd3"}
Jul 21 16:29:28.461815 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:28.461765    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fm4hg" podStartSLOduration=67.429984259 podStartE2EDuration="1m8.461747704s" totalImagesPullingTime="1.031763445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:28.460893213 +0000 UTC m=+68.857123996" watchObservedRunningTime="2026-07-21 16:29:28.461747704 +0000 UTC m=+68.857978485"
Jul 21 16:29:30.282387 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:30.282343    2524 patch_prober.go:28] interesting pod/image-registry-68f6f659cb-b5g7v container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 16:29:30.282828 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:30.282407    2524 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v" podUID="543ee99f-0626-4462-912d-8d8e781ee332" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 16:29:31.458590 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.458481    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqnr9" event={"ID":"40ee9f54-597c-4293-af7b-6790edde15f8","Type":"ContainerStarted","Data":"a6c0bb096cb6b3fc7ad83f4f716556fbae2e27b9b8a0ab40e6a4580c7feabff1"}
Jul 21 16:29:31.459021 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.458597    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:29:31.460057 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.460026    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2fs5t" event={"ID":"1be3dca0-631a-4ebd-9bfc-2cb14e931f47","Type":"ContainerStarted","Data":"f524665ed5992614bce9a38723da6a6d63949114dddb4a0b55b6ac46d26177b0"}
Jul 21 16:29:31.486313 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.486282    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mslxv"]
Jul 21 16:29:31.486537 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.486479    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dqnr9" podStartSLOduration=66.475273348 podStartE2EDuration="1m11.486465129s" totalImagesPullingTime="5.011191781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:31.484973172 +0000 UTC m=+71.881203976" watchObservedRunningTime="2026-07-21 16:29:31.486465129 +0000 UTC m=+71.882695909"
Jul 21 16:29:31.489413 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.489390    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"]
Jul 21 16:29:31.489556 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.489483    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.492262 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.492242    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.494874 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.494857    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 16:29:31.498099 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.498083    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 16:29:31.498855 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.498835    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 21 16:29:31.499260 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.499240    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 16:29:31.503266 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.503248    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 16:29:31.503361 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.503305    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-77mcm\""
Jul 21 16:29:31.503669 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.503655    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 16:29:31.503937 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.503919    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 16:29:31.504874 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.504861    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-55sbx\""
Jul 21 16:29:31.505082 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.505068    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 21 16:29:31.505346 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.505333    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 21 16:29:31.537074 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.537029    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"]
Jul 21 16:29:31.537732 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.537688    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2fs5t" podStartSLOduration=66.710813531 podStartE2EDuration="1m11.537669832s" totalImagesPullingTime="4.826856301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:31.536565098 +0000 UTC m=+71.932795872" watchObservedRunningTime="2026-07-21 16:29:31.537669832 +0000 UTC m=+71.933900604"
Jul 21 16:29:31.566691 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.566655    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-tls\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.566691 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.566691    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b875b9f-8a31-4558-a596-988af905cd45-metrics-client-ca\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.566934 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.566716    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/523f17a8-d68a-47b8-be62-575741504f5e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.566934 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.566842    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-wtmp\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.566934 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.566875    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/523f17a8-d68a-47b8-be62-575741504f5e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.566934 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.566899    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b875b9f-8a31-4558-a596-988af905cd45-sys\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.566934 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.566921    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/523f17a8-d68a-47b8-be62-575741504f5e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.567160 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.566946    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5szwk\" (UniqueName: \"kubernetes.io/projected/8b875b9f-8a31-4558-a596-988af905cd45-kube-api-access-5szwk\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.567160 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.566973    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/523f17a8-d68a-47b8-be62-575741504f5e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.567160 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.567016    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-textfile\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.567160 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.567040    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.567160 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.567063    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bldft\" (UniqueName: \"kubernetes.io/projected/523f17a8-d68a-47b8-be62-575741504f5e-kube-api-access-bldft\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.567160 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.567086    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b875b9f-8a31-4558-a596-988af905cd45-root\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.567160 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.567136    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-accelerators-collector-config\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.567547 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.567160    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/523f17a8-d68a-47b8-be62-575741504f5e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.667528 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667472    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/523f17a8-d68a-47b8-be62-575741504f5e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.667528 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667529    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-textfile\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.667764 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667548    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.667764 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667568    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bldft\" (UniqueName: \"kubernetes.io/projected/523f17a8-d68a-47b8-be62-575741504f5e-kube-api-access-bldft\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.667764 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667587    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b875b9f-8a31-4558-a596-988af905cd45-root\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.667764 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667608    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-accelerators-collector-config\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.667764 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667627    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/523f17a8-d68a-47b8-be62-575741504f5e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.667764 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667656    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-tls\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.667764 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667706    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b875b9f-8a31-4558-a596-988af905cd45-metrics-client-ca\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.667764 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667759    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/523f17a8-d68a-47b8-be62-575741504f5e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.668113 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667788    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-wtmp\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.668113 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667815    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/523f17a8-d68a-47b8-be62-575741504f5e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.668113 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667841    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b875b9f-8a31-4558-a596-988af905cd45-sys\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.668113 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667867    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/523f17a8-d68a-47b8-be62-575741504f5e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.668113 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667883    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-textfile\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.668113 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667897    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5szwk\" (UniqueName: \"kubernetes.io/projected/8b875b9f-8a31-4558-a596-988af905cd45-kube-api-access-5szwk\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.668113 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.668024    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b875b9f-8a31-4558-a596-988af905cd45-sys\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.668444 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.668148    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-wtmp\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.668444 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:31.667841    2524 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 16:29:31.668444 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.668175    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-accelerators-collector-config\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.668444 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:31.668241    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-tls podName:8b875b9f-8a31-4558-a596-988af905cd45 nodeName:}" failed. No retries permitted until 2026-07-21 16:29:32.168213497 +0000 UTC m=+72.564444260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-tls") pod "node-exporter-mslxv" (UID: "8b875b9f-8a31-4558-a596-988af905cd45") : secret "node-exporter-tls" not found
Jul 21 16:29:31.668444 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.668267    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/523f17a8-d68a-47b8-be62-575741504f5e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.668444 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.667709    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b875b9f-8a31-4558-a596-988af905cd45-root\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.668444 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.668381    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b875b9f-8a31-4558-a596-988af905cd45-metrics-client-ca\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.668706 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.668452    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/523f17a8-d68a-47b8-be62-575741504f5e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.668706 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.668656    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/523f17a8-d68a-47b8-be62-575741504f5e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.670380 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.670360    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/523f17a8-d68a-47b8-be62-575741504f5e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.670592 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.670571    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.670964 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.670946    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/523f17a8-d68a-47b8-be62-575741504f5e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.677741 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.677716    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bldft\" (UniqueName: \"kubernetes.io/projected/523f17a8-d68a-47b8-be62-575741504f5e-kube-api-access-bldft\") pod \"kube-state-metrics-56c5594674-8kjwl\" (UID: \"523f17a8-d68a-47b8-be62-575741504f5e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.678327 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.678204    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5szwk\" (UniqueName: \"kubernetes.io/projected/8b875b9f-8a31-4558-a596-988af905cd45-kube-api-access-5szwk\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:31.804072 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.804041    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"
Jul 21 16:29:31.929007 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:31.928976    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-8kjwl"]
Jul 21 16:29:31.932935 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:29:31.932909    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod523f17a8_d68a_47b8_be62_575741504f5e.slice/crio-122d49bf74fc850150c86d0fde9ddf55d8fcde041dfa420f5995155fd572d3c4 WatchSource:0}: Error finding container 122d49bf74fc850150c86d0fde9ddf55d8fcde041dfa420f5995155fd572d3c4: Status 404 returned error can't find the container with id 122d49bf74fc850150c86d0fde9ddf55d8fcde041dfa420f5995155fd572d3c4
Jul 21 16:29:32.171800 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.171713    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-tls\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:32.171952 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:32.171900    2524 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 16:29:32.172020 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:29:32.171975    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-tls podName:8b875b9f-8a31-4558-a596-988af905cd45 nodeName:}" failed. No retries permitted until 2026-07-21 16:29:33.171953371 +0000 UTC m=+73.568184132 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-tls") pod "node-exporter-mslxv" (UID: "8b875b9f-8a31-4558-a596-988af905cd45") : secret "node-exporter-tls" not found
Jul 21 16:29:32.464128 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.464032    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl" event={"ID":"523f17a8-d68a-47b8-be62-575741504f5e","Type":"ContainerStarted","Data":"122d49bf74fc850150c86d0fde9ddf55d8fcde041dfa420f5995155fd572d3c4"}
Jul 21 16:29:32.534552 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.534518    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 16:29:32.538112 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.538092    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.541251 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.541222    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 16:29:32.541397 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.541253    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 16:29:32.541397 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.541284    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 16:29:32.541499 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.541446    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 16:29:32.541580 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.541545    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pfb77\""
Jul 21 16:29:32.541630 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.541556    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 16:29:32.541891 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.541872    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 16:29:32.542122 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.542108    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 16:29:32.542400 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.542330    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 16:29:32.543540 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.543501    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 16:29:32.556208 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.556189    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 16:29:32.675878 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.675840    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnlzc\" (UniqueName: \"kubernetes.io/projected/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-kube-api-access-fnlzc\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.676097 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.675896    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.676097 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.675974    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.676097 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.676038    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.676097 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.676065    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-config-volume\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.676097 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.676091    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.676326 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.676158    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.676326 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.676197    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-web-config\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.676326 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.676232    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.676326 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.676260    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.676326 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.676296    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-config-out\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.676590 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.676329    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.676590 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.676354    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.777026 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.776990    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-config-out\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.777226 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.777040    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.777226 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.777058    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.777226 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.777124    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnlzc\" (UniqueName: \"kubernetes.io/projected/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-kube-api-access-fnlzc\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.777226 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.777164    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.777226 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.777217    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.777601 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.777408    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.777601 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.777464    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-config-volume\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.777601 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.777493    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.777601 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.777546    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.777601 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.777575    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-web-config\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.777848 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.777608    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.777848 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.777633    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.777848 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.777643    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.778755 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.778078    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.778755 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.778634    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.780339 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.780311    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-config-out\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.780459 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.780429    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.781187 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.781152    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.781379 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.781360    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.781451 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.781360    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.782717 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.782564    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.782717 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.782680    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-config-volume\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.782861 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.782811    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.783135 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.783113    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-web-config\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.785962 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.785939    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnlzc\" (UniqueName: \"kubernetes.io/projected/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-kube-api-access-fnlzc\") pod \"alertmanager-main-0\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:32.851823 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:32.851793    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:29:33.181779 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.181752    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-tls\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:33.184310 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.184281    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b875b9f-8a31-4558-a596-988af905cd45-node-exporter-tls\") pod \"node-exporter-mslxv\" (UID: \"8b875b9f-8a31-4558-a596-988af905cd45\") " pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:33.247383 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.247358    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 16:29:33.250576 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:29:33.250545    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf6bdbf6_493f_421b_b7c8_7ad6863033eb.slice/crio-9be3c9697a1c65467c6b0af914bab6a28931c525979eea222fba9536fdf9b258 WatchSource:0}: Error finding container 9be3c9697a1c65467c6b0af914bab6a28931c525979eea222fba9536fdf9b258: Status 404 returned error can't find the container with id 9be3c9697a1c65467c6b0af914bab6a28931c525979eea222fba9536fdf9b258
Jul 21 16:29:33.299332 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.299308    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mslxv"
Jul 21 16:29:33.320712 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:29:33.320675    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b875b9f_8a31_4558_a596_988af905cd45.slice/crio-b5fba2f22ba03f71b030a776c7db014a72c1ef6c1612fa691b5aff58769e5a39 WatchSource:0}: Error finding container b5fba2f22ba03f71b030a776c7db014a72c1ef6c1612fa691b5aff58769e5a39: Status 404 returned error can't find the container with id b5fba2f22ba03f71b030a776c7db014a72c1ef6c1612fa691b5aff58769e5a39
Jul 21 16:29:33.391853 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.391764    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68f6f659cb-b5g7v"
Jul 21 16:29:33.469958 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.469929    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl" event={"ID":"523f17a8-d68a-47b8-be62-575741504f5e","Type":"ContainerStarted","Data":"5a12daa3a734428283924c66118bb98e36927a745a3f272f396240221581d41a"}
Jul 21 16:29:33.470389 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.469989    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl" event={"ID":"523f17a8-d68a-47b8-be62-575741504f5e","Type":"ContainerStarted","Data":"248a8a0e88de0501e7eab5491e3c37d6afdf368e86190fe5bb551d677275fd63"}
Jul 21 16:29:33.470389 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.470021    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl" event={"ID":"523f17a8-d68a-47b8-be62-575741504f5e","Type":"ContainerStarted","Data":"50d8ff4a5955f167654ebd0809005c6d0268d0f8e2f1d4bcdaf507e8ef410f61"}
Jul 21 16:29:33.471253 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.471222    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mslxv" event={"ID":"8b875b9f-8a31-4558-a596-988af905cd45","Type":"ContainerStarted","Data":"b5fba2f22ba03f71b030a776c7db014a72c1ef6c1612fa691b5aff58769e5a39"}
Jul 21 16:29:33.472536 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.472496    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf6bdbf6-493f-421b-b7c8-7ad6863033eb","Type":"ContainerStarted","Data":"9be3c9697a1c65467c6b0af914bab6a28931c525979eea222fba9536fdf9b258"}
Jul 21 16:29:33.496672 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.496632    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-8kjwl" podStartSLOduration=1.267396502 podStartE2EDuration="2.496617852s" totalImagesPullingTime="1.22922135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:33.495953527 +0000 UTC m=+73.892184323" watchObservedRunningTime="2026-07-21 16:29:33.496617852 +0000 UTC m=+73.892848633"
Jul 21 16:29:33.578761 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.578726    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8697f86689-t2b48"]
Jul 21 16:29:33.582375 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.582355    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.585077 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.585052    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3vq12q7etiguu\""
Jul 21 16:29:33.585193 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.585054    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 21 16:29:33.585193 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.585123    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 21 16:29:33.585336 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.585203    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-m4n4l\""
Jul 21 16:29:33.585396 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.585387    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 21 16:29:33.585449 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.585406    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 21 16:29:33.585449 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.585434    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 21 16:29:33.595320 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.595217    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8697f86689-t2b48"]
Jul 21 16:29:33.686411 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.686314    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-thanos-querier-tls\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.686411 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.686377    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6lfr\" (UniqueName: \"kubernetes.io/projected/3f8254e5-d726-4885-b4fe-617ae01adbf3-kube-api-access-r6lfr\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.686635 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.686425    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.686635 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.686464    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f8254e5-d726-4885-b4fe-617ae01adbf3-metrics-client-ca\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.686635 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.686583    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.686635 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.686607    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-grpc-tls\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.686773 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.686676    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.686773 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.686717    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.787792 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.787760    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.787792 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.787791    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-grpc-tls\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.787989 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.787823    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.787989 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.787841    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.787989 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.787862    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-thanos-querier-tls\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.787989 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.787895    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6lfr\" (UniqueName: \"kubernetes.io/projected/3f8254e5-d726-4885-b4fe-617ae01adbf3-kube-api-access-r6lfr\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.787989 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.787931    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.787989 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.787964    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f8254e5-d726-4885-b4fe-617ae01adbf3-metrics-client-ca\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.788926 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.788898    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f8254e5-d726-4885-b4fe-617ae01adbf3-metrics-client-ca\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.790488 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.790461    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-thanos-querier-tls\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.790759 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.790736    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-grpc-tls\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.790870 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.790848    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.790918 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.790883    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.791034 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.791017    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.791072 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.791052    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3f8254e5-d726-4885-b4fe-617ae01adbf3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.795770 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.795754    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6lfr\" (UniqueName: \"kubernetes.io/projected/3f8254e5-d726-4885-b4fe-617ae01adbf3-kube-api-access-r6lfr\") pod \"thanos-querier-8697f86689-t2b48\" (UID: \"3f8254e5-d726-4885-b4fe-617ae01adbf3\") " pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:33.893089 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:33.893064    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:34.039366 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:34.039332    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8697f86689-t2b48"]
Jul 21 16:29:34.477275 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:34.477222    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8697f86689-t2b48" event={"ID":"3f8254e5-d726-4885-b4fe-617ae01adbf3","Type":"ContainerStarted","Data":"a4fac14f6ee507b503fdf65111a5757010f1cb1189ea2bc79e8384239f4a0300"}
Jul 21 16:29:35.482923 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:35.482843    2524 generic.go:356] "Generic (PLEG): container finished" podID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerID="e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c" exitCode=0
Jul 21 16:29:35.483356 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:35.482935    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf6bdbf6-493f-421b-b7c8-7ad6863033eb","Type":"ContainerDied","Data":"e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c"}
Jul 21 16:29:35.484395 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:35.484376    2524 generic.go:356] "Generic (PLEG): container finished" podID="8b875b9f-8a31-4558-a596-988af905cd45" containerID="3d4540b0edfa5521b2ab04e1dd55fa9ffb3a1d097d7bb09d884fab862a12226a" exitCode=0
Jul 21 16:29:35.484472 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:35.484410    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mslxv" event={"ID":"8b875b9f-8a31-4558-a596-988af905cd45","Type":"ContainerDied","Data":"3d4540b0edfa5521b2ab04e1dd55fa9ffb3a1d097d7bb09d884fab862a12226a"}
Jul 21 16:29:36.493825 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.493738    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mslxv" event={"ID":"8b875b9f-8a31-4558-a596-988af905cd45","Type":"ContainerStarted","Data":"ea589800578812fcbce03103b4707a40a5d02934883a016f92be276511a914d9"}
Jul 21 16:29:36.494260 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.493865    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mslxv" event={"ID":"8b875b9f-8a31-4558-a596-988af905cd45","Type":"ContainerStarted","Data":"c31e1ddb4a1b0997d769e6d8f91143657e666d3df0d0c5895fc834bd3bb3b8d2"}
Jul 21 16:29:36.496981 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.496947    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8697f86689-t2b48" event={"ID":"3f8254e5-d726-4885-b4fe-617ae01adbf3","Type":"ContainerStarted","Data":"bc276a657194657753f70ba6c964cffe966be573a713dd07cb0f6aca432225a4"}
Jul 21 16:29:36.497103 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.497038    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8697f86689-t2b48" event={"ID":"3f8254e5-d726-4885-b4fe-617ae01adbf3","Type":"ContainerStarted","Data":"973b19dafa8fc5c58f1d61c2b67ff64d5efb193ede09be1a7b8207c61ca5b8a7"}
Jul 21 16:29:36.497103 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.497084    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8697f86689-t2b48" event={"ID":"3f8254e5-d726-4885-b4fe-617ae01adbf3","Type":"ContainerStarted","Data":"fe9a735f7863dde0008d3c7a72c1f1a6aecea2d4e55a159745affc874e180c8d"}
Jul 21 16:29:36.517277 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.517117    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mslxv" podStartSLOduration=4.105270365 podStartE2EDuration="5.517097235s" totalImagesPullingTime="1.326479137s" totalInitContainerRuntime="85.347733ms" isStatefulPod=true podCreationTimestamp="2026-07-21 16:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:36.516794331 +0000 UTC m=+76.913025113" watchObservedRunningTime="2026-07-21 16:29:36.517097235 +0000 UTC m=+76.913328017"
Jul 21 16:29:36.699395 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.699363    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-676ff654f7-5wjjr"]
Jul 21 16:29:36.702743 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.702723    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.705337 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.705272    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 21 16:29:36.705472 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.705343    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 21 16:29:36.705472 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.705343    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 21 16:29:36.705681 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.705667    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gnzb8\""
Jul 21 16:29:36.705758 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.705697    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 21 16:29:36.705758 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.705727    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 21 16:29:36.710236 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.710220    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 21 16:29:36.714930 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.714909    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-676ff654f7-5wjjr"]
Jul 21 16:29:36.816234 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.816192    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47463d3e-76fd-4900-97e9-e5cbfeaffeec-serving-certs-ca-bundle\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.816234 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.816228    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47463d3e-76fd-4900-97e9-e5cbfeaffeec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.816497 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.816253    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/47463d3e-76fd-4900-97e9-e5cbfeaffeec-federate-client-tls\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.816497 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.816270    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm427\" (UniqueName: \"kubernetes.io/projected/47463d3e-76fd-4900-97e9-e5cbfeaffeec-kube-api-access-xm427\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.816497 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.816402    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47463d3e-76fd-4900-97e9-e5cbfeaffeec-metrics-client-ca\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.816497 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.816444    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47463d3e-76fd-4900-97e9-e5cbfeaffeec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.816662 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.816568    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/47463d3e-76fd-4900-97e9-e5cbfeaffeec-secret-telemeter-client\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.816662 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.816594    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/47463d3e-76fd-4900-97e9-e5cbfeaffeec-telemeter-client-tls\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.917221 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.917183    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47463d3e-76fd-4900-97e9-e5cbfeaffeec-metrics-client-ca\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.917420 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.917232    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47463d3e-76fd-4900-97e9-e5cbfeaffeec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.917420 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.917281    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/47463d3e-76fd-4900-97e9-e5cbfeaffeec-secret-telemeter-client\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.917420 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.917316    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/47463d3e-76fd-4900-97e9-e5cbfeaffeec-telemeter-client-tls\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.917420 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.917340    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47463d3e-76fd-4900-97e9-e5cbfeaffeec-serving-certs-ca-bundle\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.917420 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.917372    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47463d3e-76fd-4900-97e9-e5cbfeaffeec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.917420 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.917405    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/47463d3e-76fd-4900-97e9-e5cbfeaffeec-federate-client-tls\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.917748 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.917430    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm427\" (UniqueName: \"kubernetes.io/projected/47463d3e-76fd-4900-97e9-e5cbfeaffeec-kube-api-access-xm427\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.918324 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.918097    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47463d3e-76fd-4900-97e9-e5cbfeaffeec-metrics-client-ca\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.918759 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.918469    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47463d3e-76fd-4900-97e9-e5cbfeaffeec-serving-certs-ca-bundle\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.918759 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.918550    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47463d3e-76fd-4900-97e9-e5cbfeaffeec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.920382 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.920341    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/47463d3e-76fd-4900-97e9-e5cbfeaffeec-secret-telemeter-client\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.920718 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.920692    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/47463d3e-76fd-4900-97e9-e5cbfeaffeec-telemeter-client-tls\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.920808 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.920790    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/47463d3e-76fd-4900-97e9-e5cbfeaffeec-federate-client-tls\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.920917 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.920898    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/47463d3e-76fd-4900-97e9-e5cbfeaffeec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:36.926980 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:36.926950    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm427\" (UniqueName: \"kubernetes.io/projected/47463d3e-76fd-4900-97e9-e5cbfeaffeec-kube-api-access-xm427\") pod \"telemeter-client-676ff654f7-5wjjr\" (UID: \"47463d3e-76fd-4900-97e9-e5cbfeaffeec\") " pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:37.012259 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:37.012219    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr"
Jul 21 16:29:37.368245 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:37.368217    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-676ff654f7-5wjjr"]
Jul 21 16:29:37.372127 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:29:37.372099    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47463d3e_76fd_4900_97e9_e5cbfeaffeec.slice/crio-c0980bf4816dc486d5b2a3057961fb430102ee3e6cad28e153a4f68ed33572ac WatchSource:0}: Error finding container c0980bf4816dc486d5b2a3057961fb430102ee3e6cad28e153a4f68ed33572ac: Status 404 returned error can't find the container with id c0980bf4816dc486d5b2a3057961fb430102ee3e6cad28e153a4f68ed33572ac
Jul 21 16:29:37.502529 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:37.502480    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr" event={"ID":"47463d3e-76fd-4900-97e9-e5cbfeaffeec","Type":"ContainerStarted","Data":"c0980bf4816dc486d5b2a3057961fb430102ee3e6cad28e153a4f68ed33572ac"}
Jul 21 16:29:37.504936 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:37.504907    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf6bdbf6-493f-421b-b7c8-7ad6863033eb","Type":"ContainerStarted","Data":"9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759"}
Jul 21 16:29:37.505023 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:37.504987    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf6bdbf6-493f-421b-b7c8-7ad6863033eb","Type":"ContainerStarted","Data":"333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528"}
Jul 21 16:29:38.511740 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:38.511701    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8697f86689-t2b48" event={"ID":"3f8254e5-d726-4885-b4fe-617ae01adbf3","Type":"ContainerStarted","Data":"2a613d98062dde0b37c2ad10612c8ca1ddf43c5f937b162f69be488ec96b20df"}
Jul 21 16:29:38.512182 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:38.511787    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8697f86689-t2b48" event={"ID":"3f8254e5-d726-4885-b4fe-617ae01adbf3","Type":"ContainerStarted","Data":"df3a6c30a7325d831e80a030354010247cf4b888d82c0ec9f8d3e5823295e47b"}
Jul 21 16:29:38.512182 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:38.511835    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8697f86689-t2b48" event={"ID":"3f8254e5-d726-4885-b4fe-617ae01adbf3","Type":"ContainerStarted","Data":"fbc4416b5a334cfe6a92a5f0b380ad95c0d6bf56cb73540817020b443d084fad"}
Jul 21 16:29:38.512182 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:38.511884    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:29:38.515101 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:38.515073    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf6bdbf6-493f-421b-b7c8-7ad6863033eb","Type":"ContainerStarted","Data":"15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3"}
Jul 21 16:29:38.515199 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:38.515135    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf6bdbf6-493f-421b-b7c8-7ad6863033eb","Type":"ContainerStarted","Data":"23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705"}
Jul 21 16:29:38.515199 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:38.515166    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf6bdbf6-493f-421b-b7c8-7ad6863033eb","Type":"ContainerStarted","Data":"d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27"}
Jul 21 16:29:38.515280 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:38.515198    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf6bdbf6-493f-421b-b7c8-7ad6863033eb","Type":"ContainerStarted","Data":"5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7"}
Jul 21 16:29:38.541452 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:38.541401    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8697f86689-t2b48" podStartSLOduration=2.067579686 podStartE2EDuration="5.541387995s" totalImagesPullingTime="3.473808309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:29:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:38.540897254 +0000 UTC m=+78.937128035" watchObservedRunningTime="2026-07-21 16:29:38.541387995 +0000 UTC m=+78.937618775"
Jul 21 16:29:38.569864 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:38.569813    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.3542924960000002 podStartE2EDuration="6.569795487s" totalImagesPullingTime="3.197305852s" totalInitContainerRuntime="18.197139ms" isStatefulPod=false podCreationTimestamp="2026-07-21 16:29:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:38.568097441 +0000 UTC m=+78.964328221" watchObservedRunningTime="2026-07-21 16:29:38.569795487 +0000 UTC m=+78.966026268"
Jul 21 16:29:40.524776 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:40.524742    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr" event={"ID":"47463d3e-76fd-4900-97e9-e5cbfeaffeec","Type":"ContainerStarted","Data":"969253000cedb153e9a4cb552e3b7a2ab7c761a5453ce522f1b9cf1cac092f87"}
Jul 21 16:29:40.525126 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:40.524819    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr" event={"ID":"47463d3e-76fd-4900-97e9-e5cbfeaffeec","Type":"ContainerStarted","Data":"5a88254289dfdcd112a41cb9e5bf407462bf48ceb162a651d27fa267aa5d4e09"}
Jul 21 16:29:40.525126 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:40.524839    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr" event={"ID":"47463d3e-76fd-4900-97e9-e5cbfeaffeec","Type":"ContainerStarted","Data":"26f98029a3b0825c80839ccde7816f17d10107e6e2bc3196c318999806322ea0"}
Jul 21 16:29:40.551553 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:40.551491    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-676ff654f7-5wjjr" podStartSLOduration=1.9776958759999999 podStartE2EDuration="4.551478601s" totalImagesPullingTime="2.573782725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:40.549931399 +0000 UTC m=+80.946162180" watchObservedRunningTime="2026-07-21 16:29:40.551478601 +0000 UTC m=+80.947709381"
Jul 21 16:29:44.525711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:29:44.525601    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8697f86689-t2b48"
Jul 21 16:30:02.467236 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:02.467200    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dqnr9"
Jul 21 16:30:06.770502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:06.770470    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k8552_c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc/serve-healthcheck-canary/0.log"
Jul 21 16:30:51.892710 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:51.892671    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 16:30:51.893240 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:51.892960    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="alertmanager" containerID="cri-o://333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528" gracePeriod=120
Jul 21 16:30:51.893240 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:51.893038    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="kube-rbac-proxy-metric" containerID="cri-o://23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705" gracePeriod=120
Jul 21 16:30:51.893240 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:51.893108    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="prom-label-proxy" containerID="cri-o://15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3" gracePeriod=120
Jul 21 16:30:51.893240 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:51.893125    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="config-reloader" containerID="cri-o://9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759" gracePeriod=120
Jul 21 16:30:51.893240 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:51.893038    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="kube-rbac-proxy-web" containerID="cri-o://5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7" gracePeriod=120
Jul 21 16:30:51.893240 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:51.893055    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="kube-rbac-proxy" containerID="cri-o://d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27" gracePeriod=120
Jul 21 16:30:52.789105 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:52.789064    2524 generic.go:356] "Generic (PLEG): container finished" podID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerID="15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3" exitCode=0
Jul 21 16:30:52.789105 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:52.789090    2524 generic.go:356] "Generic (PLEG): container finished" podID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerID="d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27" exitCode=0
Jul 21 16:30:52.789105 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:52.789097    2524 generic.go:356] "Generic (PLEG): container finished" podID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerID="9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759" exitCode=0
Jul 21 16:30:52.789105 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:52.789103    2524 generic.go:356] "Generic (PLEG): container finished" podID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerID="333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528" exitCode=0
Jul 21 16:30:52.789398 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:52.789122    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf6bdbf6-493f-421b-b7c8-7ad6863033eb","Type":"ContainerDied","Data":"15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3"}
Jul 21 16:30:52.789398 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:52.789178    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf6bdbf6-493f-421b-b7c8-7ad6863033eb","Type":"ContainerDied","Data":"d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27"}
Jul 21 16:30:52.789398 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:52.789206    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf6bdbf6-493f-421b-b7c8-7ad6863033eb","Type":"ContainerDied","Data":"9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759"}
Jul 21 16:30:52.789398 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:52.789233    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf6bdbf6-493f-421b-b7c8-7ad6863033eb","Type":"ContainerDied","Data":"333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528"}
Jul 21 16:30:53.130343 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.130320    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:53.253086 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.253061    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-web-config\") pod \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") "
Jul 21 16:30:53.253258 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.253095    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") "
Jul 21 16:30:53.253258 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.253120    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-cluster-tls-config\") pod \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") "
Jul 21 16:30:53.253258 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.253138    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-config-volume\") pod \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") "
Jul 21 16:30:53.253258 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.253156    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-alertmanager-trusted-ca-bundle\") pod \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") "
Jul 21 16:30:53.253258 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.253188    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnlzc\" (UniqueName: \"kubernetes.io/projected/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-kube-api-access-fnlzc\") pod \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") "
Jul 21 16:30:53.253258 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.253211    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-main-tls\") pod \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") "
Jul 21 16:30:53.253606 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.253264    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy-web\") pod \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") "
Jul 21 16:30:53.253681 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.253639    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "cf6bdbf6-493f-421b-b7c8-7ad6863033eb" (UID: "cf6bdbf6-493f-421b-b7c8-7ad6863033eb"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:30:53.254191 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.253866    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-metrics-client-ca\") pod \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") "
Jul 21 16:30:53.254191 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.253916    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-config-out\") pod \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") "
Jul 21 16:30:53.254191 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.254131    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-alertmanager-main-db\") pod \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") "
Jul 21 16:30:53.254191 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.254172    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy\") pod \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") "
Jul 21 16:30:53.254485 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.254213    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-tls-assets\") pod \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\" (UID: \"cf6bdbf6-493f-421b-b7c8-7ad6863033eb\") "
Jul 21 16:30:53.254641 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.254620    2524 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:30:53.254717 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.254677    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "cf6bdbf6-493f-421b-b7c8-7ad6863033eb" (UID: "cf6bdbf6-493f-421b-b7c8-7ad6863033eb"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:30:53.254922 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.254871    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "cf6bdbf6-493f-421b-b7c8-7ad6863033eb" (UID: "cf6bdbf6-493f-421b-b7c8-7ad6863033eb"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:30:53.256280 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.256229    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "cf6bdbf6-493f-421b-b7c8-7ad6863033eb" (UID: "cf6bdbf6-493f-421b-b7c8-7ad6863033eb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:30:53.257130 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.257089    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-kube-api-access-fnlzc" (OuterVolumeSpecName: "kube-api-access-fnlzc") pod "cf6bdbf6-493f-421b-b7c8-7ad6863033eb" (UID: "cf6bdbf6-493f-421b-b7c8-7ad6863033eb"). InnerVolumeSpecName "kube-api-access-fnlzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:30:53.257448 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.257366    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-config-volume" (OuterVolumeSpecName: "config-volume") pod "cf6bdbf6-493f-421b-b7c8-7ad6863033eb" (UID: "cf6bdbf6-493f-421b-b7c8-7ad6863033eb"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:30:53.257448 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.257386    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "cf6bdbf6-493f-421b-b7c8-7ad6863033eb" (UID: "cf6bdbf6-493f-421b-b7c8-7ad6863033eb"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:30:53.257448 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.257424    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "cf6bdbf6-493f-421b-b7c8-7ad6863033eb" (UID: "cf6bdbf6-493f-421b-b7c8-7ad6863033eb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:30:53.257674 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.257489    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "cf6bdbf6-493f-421b-b7c8-7ad6863033eb" (UID: "cf6bdbf6-493f-421b-b7c8-7ad6863033eb"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:30:53.257914 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.257893    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-config-out" (OuterVolumeSpecName: "config-out") pod "cf6bdbf6-493f-421b-b7c8-7ad6863033eb" (UID: "cf6bdbf6-493f-421b-b7c8-7ad6863033eb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:30:53.258154 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.258134    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cf6bdbf6-493f-421b-b7c8-7ad6863033eb" (UID: "cf6bdbf6-493f-421b-b7c8-7ad6863033eb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:30:53.260712 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.260687    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "cf6bdbf6-493f-421b-b7c8-7ad6863033eb" (UID: "cf6bdbf6-493f-421b-b7c8-7ad6863033eb"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:30:53.266635 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.266614    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-web-config" (OuterVolumeSpecName: "web-config") pod "cf6bdbf6-493f-421b-b7c8-7ad6863033eb" (UID: "cf6bdbf6-493f-421b-b7c8-7ad6863033eb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:30:53.355797 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.355737    2524 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-tls-assets\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:30:53.355797 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.355768    2524 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-web-config\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:30:53.355797 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.355778    2524 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:30:53.355797 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.355787    2524 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-cluster-tls-config\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:30:53.355797 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.355796    2524 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-config-volume\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:30:53.355797 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.355804    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnlzc\" (UniqueName: \"kubernetes.io/projected/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-kube-api-access-fnlzc\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:30:53.356019 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.355812    2524 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-main-tls\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:30:53.356019 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.355821    2524 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:30:53.356019 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.355830    2524 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-metrics-client-ca\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:30:53.356019 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.355837    2524 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-config-out\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:30:53.356019 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.355845    2524 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-alertmanager-main-db\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:30:53.356019 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.355853    2524 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf6bdbf6-493f-421b-b7c8-7ad6863033eb-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:30:53.796182 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.796152    2524 generic.go:356] "Generic (PLEG): container finished" podID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerID="23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705" exitCode=0
Jul 21 16:30:53.796182 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.796176    2524 generic.go:356] "Generic (PLEG): container finished" podID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerID="5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7" exitCode=0
Jul 21 16:30:53.796330 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.796240    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf6bdbf6-493f-421b-b7c8-7ad6863033eb","Type":"ContainerDied","Data":"23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705"}
Jul 21 16:30:53.796368 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.796259    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:53.796368 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.796351    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf6bdbf6-493f-421b-b7c8-7ad6863033eb","Type":"ContainerDied","Data":"5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7"}
Jul 21 16:30:53.796433 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.796396    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf6bdbf6-493f-421b-b7c8-7ad6863033eb","Type":"ContainerDied","Data":"9be3c9697a1c65467c6b0af914bab6a28931c525979eea222fba9536fdf9b258"}
Jul 21 16:30:53.796465 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.796427    2524 scope.go:117] "RemoveContainer" containerID="15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3"
Jul 21 16:30:53.805668 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.805651    2524 scope.go:117] "RemoveContainer" containerID="23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705"
Jul 21 16:30:53.812693 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.812677    2524 scope.go:117] "RemoveContainer" containerID="d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27"
Jul 21 16:30:53.820105 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.820076    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 16:30:53.820783 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.820764    2524 scope.go:117] "RemoveContainer" containerID="5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7"
Jul 21 16:30:53.827195 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.827173    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 16:30:53.828233 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.828211    2524 scope.go:117] "RemoveContainer" containerID="9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759"
Jul 21 16:30:53.835059 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.835044    2524 scope.go:117] "RemoveContainer" containerID="333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528"
Jul 21 16:30:53.841902 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.841874    2524 scope.go:117] "RemoveContainer" containerID="e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c"
Jul 21 16:30:53.848906 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.848882    2524 scope.go:117] "RemoveContainer" containerID="15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3"
Jul 21 16:30:53.849198 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:30:53.849174    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3\": container with ID starting with 15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3 not found: ID does not exist" containerID="15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3"
Jul 21 16:30:53.849266 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.849204    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3"} err="failed to get container status \"15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3\": rpc error: code = NotFound desc = could not find container \"15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3\": container with ID starting with 15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3 not found: ID does not exist"
Jul 21 16:30:53.849266 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.849254    2524 scope.go:117] "RemoveContainer" containerID="23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705"
Jul 21 16:30:53.849481 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:30:53.849460    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705\": container with ID starting with 23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705 not found: ID does not exist" containerID="23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705"
Jul 21 16:30:53.849549 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.849486    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705"} err="failed to get container status \"23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705\": rpc error: code = NotFound desc = could not find container \"23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705\": container with ID starting with 23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705 not found: ID does not exist"
Jul 21 16:30:53.849549 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.849500    2524 scope.go:117] "RemoveContainer" containerID="d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27"
Jul 21 16:30:53.849730 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:30:53.849712    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27\": container with ID starting with d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27 not found: ID does not exist" containerID="d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27"
Jul 21 16:30:53.849767 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.849734    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27"} err="failed to get container status \"d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27\": rpc error: code = NotFound desc = could not find container \"d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27\": container with ID starting with d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27 not found: ID does not exist"
Jul 21 16:30:53.849767 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.849747    2524 scope.go:117] "RemoveContainer" containerID="5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7"
Jul 21 16:30:53.849930 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:30:53.849910    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7\": container with ID starting with 5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7 not found: ID does not exist" containerID="5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7"
Jul 21 16:30:53.849970 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.849933    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7"} err="failed to get container status \"5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7\": rpc error: code = NotFound desc = could not find container \"5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7\": container with ID starting with 5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7 not found: ID does not exist"
Jul 21 16:30:53.849970 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.849944    2524 scope.go:117] "RemoveContainer" containerID="9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759"
Jul 21 16:30:53.850135 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:30:53.850117    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759\": container with ID starting with 9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759 not found: ID does not exist" containerID="9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759"
Jul 21 16:30:53.850180 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.850137    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759"} err="failed to get container status \"9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759\": rpc error: code = NotFound desc = could not find container \"9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759\": container with ID starting with 9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759 not found: ID does not exist"
Jul 21 16:30:53.850180 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.850149    2524 scope.go:117] "RemoveContainer" containerID="333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528"
Jul 21 16:30:53.850385 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:30:53.850368    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528\": container with ID starting with 333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528 not found: ID does not exist" containerID="333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528"
Jul 21 16:30:53.850428 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.850388    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528"} err="failed to get container status \"333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528\": rpc error: code = NotFound desc = could not find container \"333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528\": container with ID starting with 333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528 not found: ID does not exist"
Jul 21 16:30:53.850428 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.850399    2524 scope.go:117] "RemoveContainer" containerID="e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c"
Jul 21 16:30:53.850605 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:30:53.850590    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c\": container with ID starting with e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c not found: ID does not exist" containerID="e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c"
Jul 21 16:30:53.850649 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.850608    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c"} err="failed to get container status \"e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c\": rpc error: code = NotFound desc = could not find container \"e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c\": container with ID starting with e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c not found: ID does not exist"
Jul 21 16:30:53.850649 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.850619    2524 scope.go:117] "RemoveContainer" containerID="15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3"
Jul 21 16:30:53.850813 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.850796    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3"} err="failed to get container status \"15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3\": rpc error: code = NotFound desc = could not find container \"15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3\": container with ID starting with 15a89c95e7e8f331bea2e204c6dea66ad70e132b4a660d86aafa8f91ec30d8c3 not found: ID does not exist"
Jul 21 16:30:53.850852 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.850814    2524 scope.go:117] "RemoveContainer" containerID="23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705"
Jul 21 16:30:53.851013 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.850994    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705"} err="failed to get container status \"23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705\": rpc error: code = NotFound desc = could not find container \"23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705\": container with ID starting with 23b78411eb3349b227441444e96c1eecc6e97ff6a990ff60e5894a54e31fe705 not found: ID does not exist"
Jul 21 16:30:53.851051 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.851014    2524 scope.go:117] "RemoveContainer" containerID="d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27"
Jul 21 16:30:53.851215 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.851199    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27"} err="failed to get container status \"d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27\": rpc error: code = NotFound desc = could not find container \"d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27\": container with ID starting with d3090c68fdb4aa6f4b97f50c7ab067d01e874ea45887382d2dc68a5976fc3e27 not found: ID does not exist"
Jul 21 16:30:53.851252 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.851215    2524 scope.go:117] "RemoveContainer" containerID="5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7"
Jul 21 16:30:53.851426 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.851411    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7"} err="failed to get container status \"5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7\": rpc error: code = NotFound desc = could not find container \"5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7\": container with ID starting with 5a886a27360e54721b6d331152a1c7ad1f34bde083d54d2048da484967e37ee7 not found: ID does not exist"
Jul 21 16:30:53.851464 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.851425    2524 scope.go:117] "RemoveContainer" containerID="9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759"
Jul 21 16:30:53.851675 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.851658    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759"} err="failed to get container status \"9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759\": rpc error: code = NotFound desc = could not find container \"9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759\": container with ID starting with 9b6bf811934384dcbcd47d973caea1d3b468d37728326ac238d39c9e6eed5759 not found: ID does not exist"
Jul 21 16:30:53.851675 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.851674    2524 scope.go:117] "RemoveContainer" containerID="333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528"
Jul 21 16:30:53.851851 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.851836    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528"} err="failed to get container status \"333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528\": rpc error: code = NotFound desc = could not find container \"333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528\": container with ID starting with 333d29680cf6ad1592bfabf58391aeccc95c8f309f8fc5b443c2e7aac70ae528 not found: ID does not exist"
Jul 21 16:30:53.851893 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.851851    2524 scope.go:117] "RemoveContainer" containerID="e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c"
Jul 21 16:30:53.852062 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.852046    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c"} err="failed to get container status \"e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c\": rpc error: code = NotFound desc = could not find container \"e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c\": container with ID starting with e6790b15637a700afc5dc6265f5b4b3d41fb9a4250abaf90bed92add690b965c not found: ID does not exist"
Jul 21 16:30:53.855371 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855349    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 16:30:53.855641 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855627    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="config-reloader"
Jul 21 16:30:53.855698 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855643    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="config-reloader"
Jul 21 16:30:53.855698 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855658    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="prom-label-proxy"
Jul 21 16:30:53.855698 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855663    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="prom-label-proxy"
Jul 21 16:30:53.855698 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855670    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="init-config-reloader"
Jul 21 16:30:53.855698 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855678    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="init-config-reloader"
Jul 21 16:30:53.855698 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855689    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="kube-rbac-proxy-metric"
Jul 21 16:30:53.855698 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855695    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="kube-rbac-proxy-metric"
Jul 21 16:30:53.855898 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855704    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="alertmanager"
Jul 21 16:30:53.855898 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855709    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="alertmanager"
Jul 21 16:30:53.855898 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855714    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="kube-rbac-proxy-web"
Jul 21 16:30:53.855898 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855719    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="kube-rbac-proxy-web"
Jul 21 16:30:53.855898 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855725    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="kube-rbac-proxy"
Jul 21 16:30:53.855898 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855730    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="kube-rbac-proxy"
Jul 21 16:30:53.855898 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855777    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="prom-label-proxy"
Jul 21 16:30:53.855898 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855785    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="alertmanager"
Jul 21 16:30:53.855898 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855790    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="kube-rbac-proxy-web"
Jul 21 16:30:53.855898 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855797    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="kube-rbac-proxy-metric"
Jul 21 16:30:53.855898 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855804    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="kube-rbac-proxy"
Jul 21 16:30:53.855898 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.855810    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" containerName="config-reloader"
Jul 21 16:30:53.860575 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.860556    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:53.863376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.863359    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 16:30:53.863537 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.863389    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 16:30:53.863537 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.863410    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 16:30:53.863537 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.863424    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 16:30:53.863537 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.863498    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pfb77\""
Jul 21 16:30:53.863537 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.863525    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 16:30:53.863793 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.863742    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 16:30:53.863793 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.863766    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 16:30:53.863894 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.863366    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 16:30:53.868709 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.868693    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 16:30:53.873326 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.873307    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 16:30:53.959954 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.959929    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:53.960034 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.959959    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:53.960034 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.959982    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ef99172-7100-426e-8c1f-cffe2e6423d5-config-out\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:53.960114 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.960041    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ef99172-7100-426e-8c1f-cffe2e6423d5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:53.960114 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.960075    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:53.960114 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.960091    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2xl7\" (UniqueName: \"kubernetes.io/projected/0ef99172-7100-426e-8c1f-cffe2e6423d5-kube-api-access-x2xl7\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:53.960203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.960148    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:53.960203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.960169    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-web-config\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:53.960203 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.960188    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ef99172-7100-426e-8c1f-cffe2e6423d5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:53.960297 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.960210    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ef99172-7100-426e-8c1f-cffe2e6423d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:53.960297 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.960238    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:53.960297 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.960267    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ef99172-7100-426e-8c1f-cffe2e6423d5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:53.960297 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:53.960284    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.058999 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.058933    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf6bdbf6-493f-421b-b7c8-7ad6863033eb" path="/var/lib/kubelet/pods/cf6bdbf6-493f-421b-b7c8-7ad6863033eb/volumes"
Jul 21 16:30:54.061352 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.061336    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.061444 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.061359    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2xl7\" (UniqueName: \"kubernetes.io/projected/0ef99172-7100-426e-8c1f-cffe2e6423d5-kube-api-access-x2xl7\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.061444 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.061383    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.061444 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.061398    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-web-config\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.061444 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.061415    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ef99172-7100-426e-8c1f-cffe2e6423d5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.061444 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.061440    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ef99172-7100-426e-8c1f-cffe2e6423d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.061709 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.061489    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.061709 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.061551    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ef99172-7100-426e-8c1f-cffe2e6423d5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.061709 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.061580    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.061709 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.061611    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.061709 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.061638    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.061709 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.061677    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ef99172-7100-426e-8c1f-cffe2e6423d5-config-out\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.061981 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.061745    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ef99172-7100-426e-8c1f-cffe2e6423d5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.061981 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.061861    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0ef99172-7100-426e-8c1f-cffe2e6423d5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.062684 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.062444    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ef99172-7100-426e-8c1f-cffe2e6423d5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.063298 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.063274    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0ef99172-7100-426e-8c1f-cffe2e6423d5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.064791 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.064769    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.064876 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.064818    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.064876 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.064854    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.065351 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.065328    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0ef99172-7100-426e-8c1f-cffe2e6423d5-config-out\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.065581 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.065564    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-web-config\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.065674 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.065580    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.065731 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.065710    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-config-volume\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.065931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.065913    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0ef99172-7100-426e-8c1f-cffe2e6423d5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.066815 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.066797    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ef99172-7100-426e-8c1f-cffe2e6423d5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.078678 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.078658    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2xl7\" (UniqueName: \"kubernetes.io/projected/0ef99172-7100-426e-8c1f-cffe2e6423d5-kube-api-access-x2xl7\") pod \"alertmanager-main-0\" (UID: \"0ef99172-7100-426e-8c1f-cffe2e6423d5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.169939 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.169918    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:30:54.304439 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.304382    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 16:30:54.307075 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:30:54.307053    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef99172_7100_426e_8c1f_cffe2e6423d5.slice/crio-194ea69cb86c0317496485a7fa40e450e23fe7478cee46990baf1c81ac639070 WatchSource:0}: Error finding container 194ea69cb86c0317496485a7fa40e450e23fe7478cee46990baf1c81ac639070: Status 404 returned error can't find the container with id 194ea69cb86c0317496485a7fa40e450e23fe7478cee46990baf1c81ac639070
Jul 21 16:30:54.805473 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.805432    2524 generic.go:356] "Generic (PLEG): container finished" podID="0ef99172-7100-426e-8c1f-cffe2e6423d5" containerID="e5739e099066539633cacc08dca14ca3c717b75b6722e469f1c6034340039322" exitCode=0
Jul 21 16:30:54.805848 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.805496    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ef99172-7100-426e-8c1f-cffe2e6423d5","Type":"ContainerDied","Data":"e5739e099066539633cacc08dca14ca3c717b75b6722e469f1c6034340039322"}
Jul 21 16:30:54.805848 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:54.805604    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ef99172-7100-426e-8c1f-cffe2e6423d5","Type":"ContainerStarted","Data":"194ea69cb86c0317496485a7fa40e450e23fe7478cee46990baf1c81ac639070"}
Jul 21 16:30:55.812920 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:55.812882    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ef99172-7100-426e-8c1f-cffe2e6423d5","Type":"ContainerStarted","Data":"7727cb3a71d6a636d8f546b978d6021eb8c411431e8e208219d685ea5fd1f151"}
Jul 21 16:30:55.813375 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:55.812984    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ef99172-7100-426e-8c1f-cffe2e6423d5","Type":"ContainerStarted","Data":"5ab1fcc29836e766fb67236cd4006777093556195d779fad449de6e855cc75f9"}
Jul 21 16:30:55.813375 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:55.813016    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ef99172-7100-426e-8c1f-cffe2e6423d5","Type":"ContainerStarted","Data":"1aa97167a7ec4e4ca52424e7e597346ee6621492dfbb971e0e507a2b952c0b75"}
Jul 21 16:30:55.813375 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:55.813043    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ef99172-7100-426e-8c1f-cffe2e6423d5","Type":"ContainerStarted","Data":"76e61c031809d2599e883fe31cc5fef8a7b111fbb8d8adf26b575b9fdb56c74a"}
Jul 21 16:30:55.813375 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:55.813081    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ef99172-7100-426e-8c1f-cffe2e6423d5","Type":"ContainerStarted","Data":"176cf4455cd91570ec82ff10a3b8c3c18cf842c3b6c20df288ba5c80dea56364"}
Jul 21 16:30:55.813375 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:55.813111    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0ef99172-7100-426e-8c1f-cffe2e6423d5","Type":"ContainerStarted","Data":"485150fa084a34ad001796e25d90fbe6eee7a398e4a97d2b43ac8095afdf6bf1"}
Jul 21 16:30:55.841956 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:30:55.841906    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.825258265 podStartE2EDuration="2.841888951s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.630686ms" isStatefulPod=false podCreationTimestamp="2026-07-21 16:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:30:55.840534355 +0000 UTC m=+156.236765134" watchObservedRunningTime="2026-07-21 16:30:55.841888951 +0000 UTC m=+156.238119731"
Jul 21 16:31:45.409041 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.409009    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"]
Jul 21 16:31:45.412360 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.412342    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"
Jul 21 16:31:45.416475 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.416448    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 16:31:45.416475 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.416451    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pg7gm\""
Jul 21 16:31:45.417503 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.417447    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 16:31:45.424243 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.424220    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"]
Jul 21 16:31:45.537197 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.537154    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46b30cc5-84c5-4cb8-a0f6-3223417b020e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr\" (UID: \"46b30cc5-84c5-4cb8-a0f6-3223417b020e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"
Jul 21 16:31:45.537389 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.537208    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbs66\" (UniqueName: \"kubernetes.io/projected/46b30cc5-84c5-4cb8-a0f6-3223417b020e-kube-api-access-cbs66\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr\" (UID: \"46b30cc5-84c5-4cb8-a0f6-3223417b020e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"
Jul 21 16:31:45.537389 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.537306    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46b30cc5-84c5-4cb8-a0f6-3223417b020e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr\" (UID: \"46b30cc5-84c5-4cb8-a0f6-3223417b020e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"
Jul 21 16:31:45.638066 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.638030    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46b30cc5-84c5-4cb8-a0f6-3223417b020e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr\" (UID: \"46b30cc5-84c5-4cb8-a0f6-3223417b020e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"
Jul 21 16:31:45.638190 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.638126    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46b30cc5-84c5-4cb8-a0f6-3223417b020e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr\" (UID: \"46b30cc5-84c5-4cb8-a0f6-3223417b020e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"
Jul 21 16:31:45.638190 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.638162    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbs66\" (UniqueName: \"kubernetes.io/projected/46b30cc5-84c5-4cb8-a0f6-3223417b020e-kube-api-access-cbs66\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr\" (UID: \"46b30cc5-84c5-4cb8-a0f6-3223417b020e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"
Jul 21 16:31:45.638502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.638480    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46b30cc5-84c5-4cb8-a0f6-3223417b020e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr\" (UID: \"46b30cc5-84c5-4cb8-a0f6-3223417b020e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"
Jul 21 16:31:45.638572 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.638488    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46b30cc5-84c5-4cb8-a0f6-3223417b020e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr\" (UID: \"46b30cc5-84c5-4cb8-a0f6-3223417b020e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"
Jul 21 16:31:45.655591 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.655559    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbs66\" (UniqueName: \"kubernetes.io/projected/46b30cc5-84c5-4cb8-a0f6-3223417b020e-kube-api-access-cbs66\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr\" (UID: \"46b30cc5-84c5-4cb8-a0f6-3223417b020e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"
Jul 21 16:31:45.721489 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.721398    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"
Jul 21 16:31:45.863427 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:45.863401    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"]
Jul 21 16:31:45.866458 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:31:45.866427    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b30cc5_84c5_4cb8_a0f6_3223417b020e.slice/crio-a68fce4c01295fc8ef0b703434ad607f6e5a9efe5128a2d62736aeba8c217c50 WatchSource:0}: Error finding container a68fce4c01295fc8ef0b703434ad607f6e5a9efe5128a2d62736aeba8c217c50: Status 404 returned error can't find the container with id a68fce4c01295fc8ef0b703434ad607f6e5a9efe5128a2d62736aeba8c217c50
Jul 21 16:31:46.005690 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:46.005599    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr" event={"ID":"46b30cc5-84c5-4cb8-a0f6-3223417b020e","Type":"ContainerStarted","Data":"a68fce4c01295fc8ef0b703434ad607f6e5a9efe5128a2d62736aeba8c217c50"}
Jul 21 16:31:52.031112 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:52.031082    2524 generic.go:356] "Generic (PLEG): container finished" podID="46b30cc5-84c5-4cb8-a0f6-3223417b020e" containerID="fa65427a33d3ca52deb82f592dabcacd7e3e0c3ecaeffb76a458c364e9c10ad5" exitCode=0
Jul 21 16:31:52.031451 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:52.031151    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr" event={"ID":"46b30cc5-84c5-4cb8-a0f6-3223417b020e","Type":"ContainerDied","Data":"fa65427a33d3ca52deb82f592dabcacd7e3e0c3ecaeffb76a458c364e9c10ad5"}
Jul 21 16:31:54.047570 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:54.047535    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr" event={"ID":"46b30cc5-84c5-4cb8-a0f6-3223417b020e","Type":"ContainerStarted","Data":"6d210e871eaad0df9884c2653f2f24e92d243facd2fb864f740e27d37065b23e"}
Jul 21 16:31:55.053742 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:55.053699    2524 generic.go:356] "Generic (PLEG): container finished" podID="46b30cc5-84c5-4cb8-a0f6-3223417b020e" containerID="6d210e871eaad0df9884c2653f2f24e92d243facd2fb864f740e27d37065b23e" exitCode=0
Jul 21 16:31:55.054263 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:31:55.053794    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr" event={"ID":"46b30cc5-84c5-4cb8-a0f6-3223417b020e","Type":"ContainerDied","Data":"6d210e871eaad0df9884c2653f2f24e92d243facd2fb864f740e27d37065b23e"}
Jul 21 16:32:02.083133 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:02.083099    2524 generic.go:356] "Generic (PLEG): container finished" podID="46b30cc5-84c5-4cb8-a0f6-3223417b020e" containerID="b569e76177c6af8c8dc27fde88c6aed1711f53e26df59c423cea22d32348ae61" exitCode=0
Jul 21 16:32:02.083532 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:02.083149    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr" event={"ID":"46b30cc5-84c5-4cb8-a0f6-3223417b020e","Type":"ContainerDied","Data":"b569e76177c6af8c8dc27fde88c6aed1711f53e26df59c423cea22d32348ae61"}
Jul 21 16:32:03.212302 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:03.212278    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"
Jul 21 16:32:03.264830 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:03.264797    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbs66\" (UniqueName: \"kubernetes.io/projected/46b30cc5-84c5-4cb8-a0f6-3223417b020e-kube-api-access-cbs66\") pod \"46b30cc5-84c5-4cb8-a0f6-3223417b020e\" (UID: \"46b30cc5-84c5-4cb8-a0f6-3223417b020e\") "
Jul 21 16:32:03.265009 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:03.264869    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46b30cc5-84c5-4cb8-a0f6-3223417b020e-bundle\") pod \"46b30cc5-84c5-4cb8-a0f6-3223417b020e\" (UID: \"46b30cc5-84c5-4cb8-a0f6-3223417b020e\") "
Jul 21 16:32:03.265009 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:03.264900    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46b30cc5-84c5-4cb8-a0f6-3223417b020e-util\") pod \"46b30cc5-84c5-4cb8-a0f6-3223417b020e\" (UID: \"46b30cc5-84c5-4cb8-a0f6-3223417b020e\") "
Jul 21 16:32:03.265556 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:03.265532    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46b30cc5-84c5-4cb8-a0f6-3223417b020e-bundle" (OuterVolumeSpecName: "bundle") pod "46b30cc5-84c5-4cb8-a0f6-3223417b020e" (UID: "46b30cc5-84c5-4cb8-a0f6-3223417b020e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:32:03.267100 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:03.267078    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b30cc5-84c5-4cb8-a0f6-3223417b020e-kube-api-access-cbs66" (OuterVolumeSpecName: "kube-api-access-cbs66") pod "46b30cc5-84c5-4cb8-a0f6-3223417b020e" (UID: "46b30cc5-84c5-4cb8-a0f6-3223417b020e"). InnerVolumeSpecName "kube-api-access-cbs66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:32:03.269142 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:03.269112    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46b30cc5-84c5-4cb8-a0f6-3223417b020e-util" (OuterVolumeSpecName: "util") pod "46b30cc5-84c5-4cb8-a0f6-3223417b020e" (UID: "46b30cc5-84c5-4cb8-a0f6-3223417b020e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:32:03.365758 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:03.365663    2524 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46b30cc5-84c5-4cb8-a0f6-3223417b020e-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:32:03.365758 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:03.365697    2524 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46b30cc5-84c5-4cb8-a0f6-3223417b020e-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:32:03.365758 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:03.365707    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbs66\" (UniqueName: \"kubernetes.io/projected/46b30cc5-84c5-4cb8-a0f6-3223417b020e-kube-api-access-cbs66\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:32:04.092937 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:04.092911    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr" event={"ID":"46b30cc5-84c5-4cb8-a0f6-3223417b020e","Type":"ContainerDied","Data":"a68fce4c01295fc8ef0b703434ad607f6e5a9efe5128a2d62736aeba8c217c50"}
Jul 21 16:32:04.093068 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:04.092951    2524 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a68fce4c01295fc8ef0b703434ad607f6e5a9efe5128a2d62736aeba8c217c50"
Jul 21 16:32:04.093068 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:04.092953    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ls6zr"
Jul 21 16:32:10.172324 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.172297    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bswdj"]
Jul 21 16:32:10.172786 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.172569    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46b30cc5-84c5-4cb8-a0f6-3223417b020e" containerName="pull"
Jul 21 16:32:10.172786 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.172581    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="46b30cc5-84c5-4cb8-a0f6-3223417b020e" containerName="pull"
Jul 21 16:32:10.172786 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.172592    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46b30cc5-84c5-4cb8-a0f6-3223417b020e" containerName="extract"
Jul 21 16:32:10.172786 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.172597    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="46b30cc5-84c5-4cb8-a0f6-3223417b020e" containerName="extract"
Jul 21 16:32:10.172786 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.172608    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46b30cc5-84c5-4cb8-a0f6-3223417b020e" containerName="util"
Jul 21 16:32:10.172786 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.172615    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="46b30cc5-84c5-4cb8-a0f6-3223417b020e" containerName="util"
Jul 21 16:32:10.172786 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.172663    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="46b30cc5-84c5-4cb8-a0f6-3223417b020e" containerName="extract"
Jul 21 16:32:10.237793 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.237772    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bswdj"]
Jul 21 16:32:10.237931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.237846    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bswdj"
Jul 21 16:32:10.244154 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.244133    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 21 16:32:10.244225 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.244178    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:32:10.244271 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.244133    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qp4c7\""
Jul 21 16:32:10.313466 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.313441    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv6fv\" (UniqueName: \"kubernetes.io/projected/0b0a1c37-8e2c-424e-93b0-f6238be8ebd6-kube-api-access-cv6fv\") pod \"cert-manager-operator-controller-manager-55c444bf86-bswdj\" (UID: \"0b0a1c37-8e2c-424e-93b0-f6238be8ebd6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bswdj"
Jul 21 16:32:10.313657 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.313495    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b0a1c37-8e2c-424e-93b0-f6238be8ebd6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bswdj\" (UID: \"0b0a1c37-8e2c-424e-93b0-f6238be8ebd6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bswdj"
Jul 21 16:32:10.413790 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.413757    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b0a1c37-8e2c-424e-93b0-f6238be8ebd6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bswdj\" (UID: \"0b0a1c37-8e2c-424e-93b0-f6238be8ebd6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bswdj"
Jul 21 16:32:10.413919 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.413818    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv6fv\" (UniqueName: \"kubernetes.io/projected/0b0a1c37-8e2c-424e-93b0-f6238be8ebd6-kube-api-access-cv6fv\") pod \"cert-manager-operator-controller-manager-55c444bf86-bswdj\" (UID: \"0b0a1c37-8e2c-424e-93b0-f6238be8ebd6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bswdj"
Jul 21 16:32:10.414167 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.414144    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b0a1c37-8e2c-424e-93b0-f6238be8ebd6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bswdj\" (UID: \"0b0a1c37-8e2c-424e-93b0-f6238be8ebd6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bswdj"
Jul 21 16:32:10.434570 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.434503    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv6fv\" (UniqueName: \"kubernetes.io/projected/0b0a1c37-8e2c-424e-93b0-f6238be8ebd6-kube-api-access-cv6fv\") pod \"cert-manager-operator-controller-manager-55c444bf86-bswdj\" (UID: \"0b0a1c37-8e2c-424e-93b0-f6238be8ebd6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bswdj"
Jul 21 16:32:10.546404 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.546382    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bswdj"
Jul 21 16:32:10.764961 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:10.764937    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bswdj"]
Jul 21 16:32:10.767814 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:32:10.767788    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b0a1c37_8e2c_424e_93b0_f6238be8ebd6.slice/crio-7b9e7f6d1fed94d4126dfd79a3583076b080f90a63ddd081d9449a0efbfd348b WatchSource:0}: Error finding container 7b9e7f6d1fed94d4126dfd79a3583076b080f90a63ddd081d9449a0efbfd348b: Status 404 returned error can't find the container with id 7b9e7f6d1fed94d4126dfd79a3583076b080f90a63ddd081d9449a0efbfd348b
Jul 21 16:32:11.118578 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:11.118547    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bswdj" event={"ID":"0b0a1c37-8e2c-424e-93b0-f6238be8ebd6","Type":"ContainerStarted","Data":"7b9e7f6d1fed94d4126dfd79a3583076b080f90a63ddd081d9449a0efbfd348b"}
Jul 21 16:32:14.135670 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.135636    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bswdj" event={"ID":"0b0a1c37-8e2c-424e-93b0-f6238be8ebd6","Type":"ContainerStarted","Data":"d2e4ebad05f2076e2da360481a1d97306da6402666005151b942c86699875d35"}
Jul 21 16:32:14.173004 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.172956    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bswdj" podStartSLOduration=1.917863831 podStartE2EDuration="4.172943581s" totalImagesPullingTime="2.25507975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:14.17180416 +0000 UTC m=+234.568034940" watchObservedRunningTime="2026-07-21 16:32:14.172943581 +0000 UTC m=+234.569174361"
Jul 21 16:32:14.232489 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.232463    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h5jdl"]
Jul 21 16:32:14.258713 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.258690    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h5jdl"]
Jul 21 16:32:14.258824 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.258789    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-h5jdl"
Jul 21 16:32:14.261243 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.261221    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 21 16:32:14.261621 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.261603    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-r2w48\""
Jul 21 16:32:14.261740 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.261611    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 21 16:32:14.343625 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.343601    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a709afe-77c1-4fa6-9af9-a73aa7a4a3a0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h5jdl\" (UID: \"3a709afe-77c1-4fa6-9af9-a73aa7a4a3a0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h5jdl"
Jul 21 16:32:14.343719 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.343628    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jwvm\" (UniqueName: \"kubernetes.io/projected/3a709afe-77c1-4fa6-9af9-a73aa7a4a3a0-kube-api-access-7jwvm\") pod \"cert-manager-webhook-6486ffd997-h5jdl\" (UID: \"3a709afe-77c1-4fa6-9af9-a73aa7a4a3a0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h5jdl"
Jul 21 16:32:14.444431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.444373    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a709afe-77c1-4fa6-9af9-a73aa7a4a3a0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h5jdl\" (UID: \"3a709afe-77c1-4fa6-9af9-a73aa7a4a3a0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h5jdl"
Jul 21 16:32:14.444431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.444403    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jwvm\" (UniqueName: \"kubernetes.io/projected/3a709afe-77c1-4fa6-9af9-a73aa7a4a3a0-kube-api-access-7jwvm\") pod \"cert-manager-webhook-6486ffd997-h5jdl\" (UID: \"3a709afe-77c1-4fa6-9af9-a73aa7a4a3a0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h5jdl"
Jul 21 16:32:14.455424 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.455397    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jwvm\" (UniqueName: \"kubernetes.io/projected/3a709afe-77c1-4fa6-9af9-a73aa7a4a3a0-kube-api-access-7jwvm\") pod \"cert-manager-webhook-6486ffd997-h5jdl\" (UID: \"3a709afe-77c1-4fa6-9af9-a73aa7a4a3a0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h5jdl"
Jul 21 16:32:14.455497 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.455403    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a709afe-77c1-4fa6-9af9-a73aa7a4a3a0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-h5jdl\" (UID: \"3a709afe-77c1-4fa6-9af9-a73aa7a4a3a0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-h5jdl"
Jul 21 16:32:14.584389 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.584358    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-h5jdl"
Jul 21 16:32:14.771323 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:14.771299    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-h5jdl"]
Jul 21 16:32:14.773135 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:32:14.773111    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a709afe_77c1_4fa6_9af9_a73aa7a4a3a0.slice/crio-46666cdca6be7d2b1ea233f6ec0817d0261f62835c5ea52c7ea65ca2b07f0e99 WatchSource:0}: Error finding container 46666cdca6be7d2b1ea233f6ec0817d0261f62835c5ea52c7ea65ca2b07f0e99: Status 404 returned error can't find the container with id 46666cdca6be7d2b1ea233f6ec0817d0261f62835c5ea52c7ea65ca2b07f0e99
Jul 21 16:32:15.095436 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.095347    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"]
Jul 21 16:32:15.099376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.099360    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"
Jul 21 16:32:15.107554 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.107532    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pg7gm\""
Jul 21 16:32:15.107672 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.107551    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 16:32:15.107672 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.107538    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 16:32:15.140670 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.140641    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-h5jdl" event={"ID":"3a709afe-77c1-4fa6-9af9-a73aa7a4a3a0","Type":"ContainerStarted","Data":"46666cdca6be7d2b1ea233f6ec0817d0261f62835c5ea52c7ea65ca2b07f0e99"}
Jul 21 16:32:15.143879 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.143852    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"]
Jul 21 16:32:15.151087 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.151064    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79pqs\" (UniqueName: \"kubernetes.io/projected/c23e3309-9522-4454-9df7-2fb20b7a1492-kube-api-access-79pqs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg\" (UID: \"c23e3309-9522-4454-9df7-2fb20b7a1492\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"
Jul 21 16:32:15.151180 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.151091    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c23e3309-9522-4454-9df7-2fb20b7a1492-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg\" (UID: \"c23e3309-9522-4454-9df7-2fb20b7a1492\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"
Jul 21 16:32:15.151180 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.151116    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c23e3309-9522-4454-9df7-2fb20b7a1492-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg\" (UID: \"c23e3309-9522-4454-9df7-2fb20b7a1492\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"
Jul 21 16:32:15.252278 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.252243    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79pqs\" (UniqueName: \"kubernetes.io/projected/c23e3309-9522-4454-9df7-2fb20b7a1492-kube-api-access-79pqs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg\" (UID: \"c23e3309-9522-4454-9df7-2fb20b7a1492\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"
Jul 21 16:32:15.252383 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.252287    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c23e3309-9522-4454-9df7-2fb20b7a1492-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg\" (UID: \"c23e3309-9522-4454-9df7-2fb20b7a1492\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"
Jul 21 16:32:15.252383 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.252312    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c23e3309-9522-4454-9df7-2fb20b7a1492-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg\" (UID: \"c23e3309-9522-4454-9df7-2fb20b7a1492\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"
Jul 21 16:32:15.252662 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.252643    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c23e3309-9522-4454-9df7-2fb20b7a1492-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg\" (UID: \"c23e3309-9522-4454-9df7-2fb20b7a1492\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"
Jul 21 16:32:15.252734 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.252678    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c23e3309-9522-4454-9df7-2fb20b7a1492-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg\" (UID: \"c23e3309-9522-4454-9df7-2fb20b7a1492\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"
Jul 21 16:32:15.284896 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.284871    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79pqs\" (UniqueName: \"kubernetes.io/projected/c23e3309-9522-4454-9df7-2fb20b7a1492-kube-api-access-79pqs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg\" (UID: \"c23e3309-9522-4454-9df7-2fb20b7a1492\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"
Jul 21 16:32:15.408781 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.408730    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"
Jul 21 16:32:15.568278 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:15.568256    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"]
Jul 21 16:32:15.570134 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:32:15.570104    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23e3309_9522_4454_9df7_2fb20b7a1492.slice/crio-39279af7b6decdc7a8fa7668bef84668d6832bdd627c0ac527f558e48b8ce23f WatchSource:0}: Error finding container 39279af7b6decdc7a8fa7668bef84668d6832bdd627c0ac527f558e48b8ce23f: Status 404 returned error can't find the container with id 39279af7b6decdc7a8fa7668bef84668d6832bdd627c0ac527f558e48b8ce23f
Jul 21 16:32:16.145474 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:16.145442    2524 generic.go:356] "Generic (PLEG): container finished" podID="c23e3309-9522-4454-9df7-2fb20b7a1492" containerID="b8a2dad6e394dc6bfa64b96b08615fd2352e3d17f5638d8529c91f9197b37130" exitCode=0
Jul 21 16:32:16.145841 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:16.145535    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg" event={"ID":"c23e3309-9522-4454-9df7-2fb20b7a1492","Type":"ContainerDied","Data":"b8a2dad6e394dc6bfa64b96b08615fd2352e3d17f5638d8529c91f9197b37130"}
Jul 21 16:32:16.145841 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:16.145589    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg" event={"ID":"c23e3309-9522-4454-9df7-2fb20b7a1492","Type":"ContainerStarted","Data":"39279af7b6decdc7a8fa7668bef84668d6832bdd627c0ac527f558e48b8ce23f"}
Jul 21 16:32:16.686971 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:16.686938    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j2rsw"]
Jul 21 16:32:16.690200 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:16.690181    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2rsw"
Jul 21 16:32:16.693928 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:16.693907    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fvqwz\""
Jul 21 16:32:16.708057 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:16.708034    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j2rsw"]
Jul 21 16:32:16.766464 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:16.766432    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2vd2\" (UniqueName: \"kubernetes.io/projected/3fe5fd76-d195-4a9e-995b-c4de4d09ac19-kube-api-access-l2vd2\") pod \"cert-manager-cainjector-559cdd8c87-j2rsw\" (UID: \"3fe5fd76-d195-4a9e-995b-c4de4d09ac19\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2rsw"
Jul 21 16:32:16.766603 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:16.766586    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fe5fd76-d195-4a9e-995b-c4de4d09ac19-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j2rsw\" (UID: \"3fe5fd76-d195-4a9e-995b-c4de4d09ac19\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2rsw"
Jul 21 16:32:16.867755 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:16.867723    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fe5fd76-d195-4a9e-995b-c4de4d09ac19-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j2rsw\" (UID: \"3fe5fd76-d195-4a9e-995b-c4de4d09ac19\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2rsw"
Jul 21 16:32:16.867877 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:16.867773    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2vd2\" (UniqueName: \"kubernetes.io/projected/3fe5fd76-d195-4a9e-995b-c4de4d09ac19-kube-api-access-l2vd2\") pod \"cert-manager-cainjector-559cdd8c87-j2rsw\" (UID: \"3fe5fd76-d195-4a9e-995b-c4de4d09ac19\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2rsw"
Jul 21 16:32:16.883192 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:16.883164    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fe5fd76-d195-4a9e-995b-c4de4d09ac19-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j2rsw\" (UID: \"3fe5fd76-d195-4a9e-995b-c4de4d09ac19\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2rsw"
Jul 21 16:32:16.883736 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:16.883718    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2vd2\" (UniqueName: \"kubernetes.io/projected/3fe5fd76-d195-4a9e-995b-c4de4d09ac19-kube-api-access-l2vd2\") pod \"cert-manager-cainjector-559cdd8c87-j2rsw\" (UID: \"3fe5fd76-d195-4a9e-995b-c4de4d09ac19\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2rsw"
Jul 21 16:32:17.000087 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:17.000023    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2rsw"
Jul 21 16:32:17.158155 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:17.158133    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j2rsw"]
Jul 21 16:32:17.160862 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:32:17.160834    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fe5fd76_d195_4a9e_995b_c4de4d09ac19.slice/crio-aa5c7b2f060a402287de6ca092ffeac96ecbd4361ae83f132a7f94ea0c9e5573 WatchSource:0}: Error finding container aa5c7b2f060a402287de6ca092ffeac96ecbd4361ae83f132a7f94ea0c9e5573: Status 404 returned error can't find the container with id aa5c7b2f060a402287de6ca092ffeac96ecbd4361ae83f132a7f94ea0c9e5573
Jul 21 16:32:18.158207 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:18.158138    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2rsw" event={"ID":"3fe5fd76-d195-4a9e-995b-c4de4d09ac19","Type":"ContainerStarted","Data":"aa5c7b2f060a402287de6ca092ffeac96ecbd4361ae83f132a7f94ea0c9e5573"}
Jul 21 16:32:20.170338 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:20.170306    2524 generic.go:356] "Generic (PLEG): container finished" podID="c23e3309-9522-4454-9df7-2fb20b7a1492" containerID="7d8e37ba92bf61c2c03e1d40a9412f752b13e1ddf91f6753a1606a8a3da6cf51" exitCode=0
Jul 21 16:32:20.170826 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:20.170386    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg" event={"ID":"c23e3309-9522-4454-9df7-2fb20b7a1492","Type":"ContainerDied","Data":"7d8e37ba92bf61c2c03e1d40a9412f752b13e1ddf91f6753a1606a8a3da6cf51"}
Jul 21 16:32:20.171937 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:20.171909    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2rsw" event={"ID":"3fe5fd76-d195-4a9e-995b-c4de4d09ac19","Type":"ContainerStarted","Data":"2c2de8e1fe8399cc287dae7c25bd83a16b6985340f4d27f8704e2ced6c676d79"}
Jul 21 16:32:20.173415 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:20.173390    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-h5jdl" event={"ID":"3a709afe-77c1-4fa6-9af9-a73aa7a4a3a0","Type":"ContainerStarted","Data":"69c2d6d54e241f1baa64487015eca8884495615f2e1c43d0ae757052ec884f5a"}
Jul 21 16:32:20.173556 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:20.173542    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-h5jdl"
Jul 21 16:32:20.205758 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:20.205720    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j2rsw" podStartSLOduration=1.604164594 podStartE2EDuration="4.205706688s" totalImagesPullingTime="2.601542094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:20.204933253 +0000 UTC m=+240.601164035" watchObservedRunningTime="2026-07-21 16:32:20.205706688 +0000 UTC m=+240.601937447"
Jul 21 16:32:20.223159 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:20.223115    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-h5jdl" podStartSLOduration=1.239936829 podStartE2EDuration="6.223100478s" totalImagesPullingTime="4.983163649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:20.221596971 +0000 UTC m=+240.617827754" watchObservedRunningTime="2026-07-21 16:32:20.223100478 +0000 UTC m=+240.619331258"
Jul 21 16:32:21.180000 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:21.179909    2524 generic.go:356] "Generic (PLEG): container finished" podID="c23e3309-9522-4454-9df7-2fb20b7a1492" containerID="4a4be05fa570c706ae1cbe2ce499e75e7c51bb8051a538567f8f2de434bf03a2" exitCode=0
Jul 21 16:32:21.180000 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:21.179974    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg" event={"ID":"c23e3309-9522-4454-9df7-2fb20b7a1492","Type":"ContainerDied","Data":"4a4be05fa570c706ae1cbe2ce499e75e7c51bb8051a538567f8f2de434bf03a2"}
Jul 21 16:32:22.317080 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:22.317054    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"
Jul 21 16:32:22.415460 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:22.415434    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c23e3309-9522-4454-9df7-2fb20b7a1492-bundle\") pod \"c23e3309-9522-4454-9df7-2fb20b7a1492\" (UID: \"c23e3309-9522-4454-9df7-2fb20b7a1492\") "
Jul 21 16:32:22.415612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:22.415478    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79pqs\" (UniqueName: \"kubernetes.io/projected/c23e3309-9522-4454-9df7-2fb20b7a1492-kube-api-access-79pqs\") pod \"c23e3309-9522-4454-9df7-2fb20b7a1492\" (UID: \"c23e3309-9522-4454-9df7-2fb20b7a1492\") "
Jul 21 16:32:22.415612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:22.415530    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c23e3309-9522-4454-9df7-2fb20b7a1492-util\") pod \"c23e3309-9522-4454-9df7-2fb20b7a1492\" (UID: \"c23e3309-9522-4454-9df7-2fb20b7a1492\") "
Jul 21 16:32:22.415822 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:22.415802    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23e3309-9522-4454-9df7-2fb20b7a1492-bundle" (OuterVolumeSpecName: "bundle") pod "c23e3309-9522-4454-9df7-2fb20b7a1492" (UID: "c23e3309-9522-4454-9df7-2fb20b7a1492"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:32:22.417591 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:22.417572    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c23e3309-9522-4454-9df7-2fb20b7a1492-kube-api-access-79pqs" (OuterVolumeSpecName: "kube-api-access-79pqs") pod "c23e3309-9522-4454-9df7-2fb20b7a1492" (UID: "c23e3309-9522-4454-9df7-2fb20b7a1492"). InnerVolumeSpecName "kube-api-access-79pqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:32:22.422470 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:22.422445    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23e3309-9522-4454-9df7-2fb20b7a1492-util" (OuterVolumeSpecName: "util") pod "c23e3309-9522-4454-9df7-2fb20b7a1492" (UID: "c23e3309-9522-4454-9df7-2fb20b7a1492"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:32:22.516760 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:22.516734    2524 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c23e3309-9522-4454-9df7-2fb20b7a1492-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:32:22.516760 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:22.516759    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79pqs\" (UniqueName: \"kubernetes.io/projected/c23e3309-9522-4454-9df7-2fb20b7a1492-kube-api-access-79pqs\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:32:22.516895 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:22.516774    2524 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c23e3309-9522-4454-9df7-2fb20b7a1492-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:32:23.191241 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:23.191213    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg"
Jul 21 16:32:23.191241 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:23.191225    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7pfjg" event={"ID":"c23e3309-9522-4454-9df7-2fb20b7a1492","Type":"ContainerDied","Data":"39279af7b6decdc7a8fa7668bef84668d6832bdd627c0ac527f558e48b8ce23f"}
Jul 21 16:32:23.191437 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:23.191275    2524 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39279af7b6decdc7a8fa7668bef84668d6832bdd627c0ac527f558e48b8ce23f"
Jul 21 16:32:26.182372 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:26.182342    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-h5jdl"
Jul 21 16:32:26.974112 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:26.974067    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nc5zn"]
Jul 21 16:32:26.974462 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:26.974442    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c23e3309-9522-4454-9df7-2fb20b7a1492" containerName="pull"
Jul 21 16:32:26.974580 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:26.974466    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="c23e3309-9522-4454-9df7-2fb20b7a1492" containerName="pull"
Jul 21 16:32:26.974580 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:26.974485    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c23e3309-9522-4454-9df7-2fb20b7a1492" containerName="util"
Jul 21 16:32:26.974580 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:26.974493    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="c23e3309-9522-4454-9df7-2fb20b7a1492" containerName="util"
Jul 21 16:32:26.974580 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:26.974528    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c23e3309-9522-4454-9df7-2fb20b7a1492" containerName="extract"
Jul 21 16:32:26.974580 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:26.974539    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="c23e3309-9522-4454-9df7-2fb20b7a1492" containerName="extract"
Jul 21 16:32:26.974802 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:26.974630    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="c23e3309-9522-4454-9df7-2fb20b7a1492" containerName="extract"
Jul 21 16:32:26.978389 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:26.978366    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nc5zn"
Jul 21 16:32:26.983002 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:26.982980    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 16:32:26.983880 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:26.983861    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:32:26.983988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:26.983875    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-jrw42\""
Jul 21 16:32:27.004304 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:27.004270    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nc5zn"]
Jul 21 16:32:27.047312 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:27.047282    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cc6e406-2264-489d-979f-b11fe1a3fa09-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nc5zn\" (UID: \"5cc6e406-2264-489d-979f-b11fe1a3fa09\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nc5zn"
Jul 21 16:32:27.047405 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:27.047340    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sddnm\" (UniqueName: \"kubernetes.io/projected/5cc6e406-2264-489d-979f-b11fe1a3fa09-kube-api-access-sddnm\") pod \"openshift-lws-operator-fd8ccff4c-nc5zn\" (UID: \"5cc6e406-2264-489d-979f-b11fe1a3fa09\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nc5zn"
Jul 21 16:32:27.148433 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:27.148401    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sddnm\" (UniqueName: \"kubernetes.io/projected/5cc6e406-2264-489d-979f-b11fe1a3fa09-kube-api-access-sddnm\") pod \"openshift-lws-operator-fd8ccff4c-nc5zn\" (UID: \"5cc6e406-2264-489d-979f-b11fe1a3fa09\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nc5zn"
Jul 21 16:32:27.148564 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:27.148532    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cc6e406-2264-489d-979f-b11fe1a3fa09-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nc5zn\" (UID: \"5cc6e406-2264-489d-979f-b11fe1a3fa09\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nc5zn"
Jul 21 16:32:27.149046 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:27.149026    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cc6e406-2264-489d-979f-b11fe1a3fa09-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nc5zn\" (UID: \"5cc6e406-2264-489d-979f-b11fe1a3fa09\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nc5zn"
Jul 21 16:32:27.167597 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:27.167575    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sddnm\" (UniqueName: \"kubernetes.io/projected/5cc6e406-2264-489d-979f-b11fe1a3fa09-kube-api-access-sddnm\") pod \"openshift-lws-operator-fd8ccff4c-nc5zn\" (UID: \"5cc6e406-2264-489d-979f-b11fe1a3fa09\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nc5zn"
Jul 21 16:32:27.287836 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:27.287810    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nc5zn"
Jul 21 16:32:27.438477 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:27.438455    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nc5zn"]
Jul 21 16:32:27.440895 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:32:27.440866    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cc6e406_2264_489d_979f_b11fe1a3fa09.slice/crio-6e3422c0e583d040877cb0404359d1dfbd23866817ad396a78d4e91d03491273 WatchSource:0}: Error finding container 6e3422c0e583d040877cb0404359d1dfbd23866817ad396a78d4e91d03491273: Status 404 returned error can't find the container with id 6e3422c0e583d040877cb0404359d1dfbd23866817ad396a78d4e91d03491273
Jul 21 16:32:28.213307 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:28.213262    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nc5zn" event={"ID":"5cc6e406-2264-489d-979f-b11fe1a3fa09","Type":"ContainerStarted","Data":"6e3422c0e583d040877cb0404359d1dfbd23866817ad396a78d4e91d03491273"}
Jul 21 16:32:31.229369 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:31.229334    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nc5zn" event={"ID":"5cc6e406-2264-489d-979f-b11fe1a3fa09","Type":"ContainerStarted","Data":"9fb0e4b46e3e3026674d63d3c98aec29fbeef5d39663fe417b4cf54c665f64a6"}
Jul 21 16:32:31.268978 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:31.268932    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nc5zn" podStartSLOduration=2.470709722 podStartE2EDuration="5.268918021s" totalImagesPullingTime="2.798208299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:31.266495475 +0000 UTC m=+251.662726255" watchObservedRunningTime="2026-07-21 16:32:31.268918021 +0000 UTC m=+251.665148801"
Jul 21 16:32:33.814429 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:33.814388    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"]
Jul 21 16:32:33.817974 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:33.817955    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"
Jul 21 16:32:33.820745 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:33.820717    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 16:32:33.820907 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:33.820838    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pg7gm\""
Jul 21 16:32:33.821726 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:33.821709    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 16:32:33.832125 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:33.832103    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"]
Jul 21 16:32:33.907031 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:33.907010    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwz7n\" (UniqueName: \"kubernetes.io/projected/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-kube-api-access-hwz7n\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh\" (UID: \"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"
Jul 21 16:32:33.907137 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:33.907047    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh\" (UID: \"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"
Jul 21 16:32:33.907137 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:33.907094    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh\" (UID: \"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"
Jul 21 16:32:34.008371 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:34.008339    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh\" (UID: \"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"
Jul 21 16:32:34.008478 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:34.008402    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh\" (UID: \"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"
Jul 21 16:32:34.008478 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:34.008442    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwz7n\" (UniqueName: \"kubernetes.io/projected/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-kube-api-access-hwz7n\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh\" (UID: \"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"
Jul 21 16:32:34.008712 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:34.008692    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh\" (UID: \"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"
Jul 21 16:32:34.008780 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:34.008733    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh\" (UID: \"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"
Jul 21 16:32:34.019914 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:34.019887    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwz7n\" (UniqueName: \"kubernetes.io/projected/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-kube-api-access-hwz7n\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh\" (UID: \"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"
Jul 21 16:32:34.127045 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:34.126990    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"
Jul 21 16:32:34.262541 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:34.262498    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"]
Jul 21 16:32:34.262791 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:32:34.262767    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f40e5c_8350_4f82_9761_1e56c9c7f2a7.slice/crio-1f9d0aa3e8c1945a0803723159e80650bb2f567cc037d5ec209c1a70f1a46b41 WatchSource:0}: Error finding container 1f9d0aa3e8c1945a0803723159e80650bb2f567cc037d5ec209c1a70f1a46b41: Status 404 returned error can't find the container with id 1f9d0aa3e8c1945a0803723159e80650bb2f567cc037d5ec209c1a70f1a46b41
Jul 21 16:32:35.254123 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:35.254083    2524 generic.go:356] "Generic (PLEG): container finished" podID="f1f40e5c-8350-4f82-9761-1e56c9c7f2a7" containerID="2c8e237c5baa2e58d298d9a0ca3b51280c7f6f48dedb96ced02729099124c884" exitCode=0
Jul 21 16:32:35.254523 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:35.254176    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh" event={"ID":"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7","Type":"ContainerDied","Data":"2c8e237c5baa2e58d298d9a0ca3b51280c7f6f48dedb96ced02729099124c884"}
Jul 21 16:32:35.254523 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:35.254251    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh" event={"ID":"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7","Type":"ContainerStarted","Data":"1f9d0aa3e8c1945a0803723159e80650bb2f567cc037d5ec209c1a70f1a46b41"}
Jul 21 16:32:36.259986 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:36.259956    2524 generic.go:356] "Generic (PLEG): container finished" podID="f1f40e5c-8350-4f82-9761-1e56c9c7f2a7" containerID="6a30731e7641229ca7b3c60cbf6ed282325256f1e9b472bb7994c941c84d9eec" exitCode=0
Jul 21 16:32:36.260350 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:36.260028    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh" event={"ID":"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7","Type":"ContainerDied","Data":"6a30731e7641229ca7b3c60cbf6ed282325256f1e9b472bb7994c941c84d9eec"}
Jul 21 16:32:37.267195 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:37.267153    2524 generic.go:356] "Generic (PLEG): container finished" podID="f1f40e5c-8350-4f82-9761-1e56c9c7f2a7" containerID="13c33178240b1e0d5405921e928a0227e6b55c97e9fc20e3a6dce103ae1f6ee5" exitCode=0
Jul 21 16:32:37.267628 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:37.267214    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh" event={"ID":"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7","Type":"ContainerDied","Data":"13c33178240b1e0d5405921e928a0227e6b55c97e9fc20e3a6dce103ae1f6ee5"}
Jul 21 16:32:38.401334 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:38.401312    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"
Jul 21 16:32:38.540269 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:38.540199    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-util\") pod \"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7\" (UID: \"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7\") "
Jul 21 16:32:38.540269 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:38.540263    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwz7n\" (UniqueName: \"kubernetes.io/projected/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-kube-api-access-hwz7n\") pod \"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7\" (UID: \"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7\") "
Jul 21 16:32:38.540468 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:38.540282    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-bundle\") pod \"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7\" (UID: \"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7\") "
Jul 21 16:32:38.540997 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:38.540969    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-bundle" (OuterVolumeSpecName: "bundle") pod "f1f40e5c-8350-4f82-9761-1e56c9c7f2a7" (UID: "f1f40e5c-8350-4f82-9761-1e56c9c7f2a7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:32:38.542349 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:38.542326    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-kube-api-access-hwz7n" (OuterVolumeSpecName: "kube-api-access-hwz7n") pod "f1f40e5c-8350-4f82-9761-1e56c9c7f2a7" (UID: "f1f40e5c-8350-4f82-9761-1e56c9c7f2a7"). InnerVolumeSpecName "kube-api-access-hwz7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:32:38.546099 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:38.546078    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-util" (OuterVolumeSpecName: "util") pod "f1f40e5c-8350-4f82-9761-1e56c9c7f2a7" (UID: "f1f40e5c-8350-4f82-9761-1e56c9c7f2a7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:32:38.641701 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:38.641674    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwz7n\" (UniqueName: \"kubernetes.io/projected/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-kube-api-access-hwz7n\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:32:38.641701 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:38.641698    2524 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:32:38.641821 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:38.641713    2524 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1f40e5c-8350-4f82-9761-1e56c9c7f2a7-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:32:39.279650 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:39.279611    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh" event={"ID":"f1f40e5c-8350-4f82-9761-1e56c9c7f2a7","Type":"ContainerDied","Data":"1f9d0aa3e8c1945a0803723159e80650bb2f567cc037d5ec209c1a70f1a46b41"}
Jul 21 16:32:39.279831 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:39.279664    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afw25zh"
Jul 21 16:32:39.279831 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:39.279671    2524 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f9d0aa3e8c1945a0803723159e80650bb2f567cc037d5ec209c1a70f1a46b41"
Jul 21 16:32:48.349104 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.349016    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"]
Jul 21 16:32:48.349829 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.349489    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f40e5c-8350-4f82-9761-1e56c9c7f2a7" containerName="util"
Jul 21 16:32:48.349829 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.349528    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f40e5c-8350-4f82-9761-1e56c9c7f2a7" containerName="util"
Jul 21 16:32:48.349829 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.349541    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f40e5c-8350-4f82-9761-1e56c9c7f2a7" containerName="pull"
Jul 21 16:32:48.349829 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.349550    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f40e5c-8350-4f82-9761-1e56c9c7f2a7" containerName="pull"
Jul 21 16:32:48.349829 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.349558    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f40e5c-8350-4f82-9761-1e56c9c7f2a7" containerName="extract"
Jul 21 16:32:48.349829 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.349566    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f40e5c-8350-4f82-9761-1e56c9c7f2a7" containerName="extract"
Jul 21 16:32:48.349829 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.349650    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1f40e5c-8350-4f82-9761-1e56c9c7f2a7" containerName="extract"
Jul 21 16:32:48.353140 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.353120    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.357438 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.357416    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 16:32:48.358480 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.358458    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 16:32:48.358816 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.358798    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 16:32:48.358904 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.358889    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2bwxz\""
Jul 21 16:32:48.388902 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.388881    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"]
Jul 21 16:32:48.390846 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.390827    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 16:32:48.516033 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.516001    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe8262ab-56cd-4d51-88bf-2f04bbb934e9-webhook-cert\") pod \"opendatahub-operator-controller-manager-87c9445c4-g6msx\" (UID: \"fe8262ab-56cd-4d51-88bf-2f04bbb934e9\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.516033 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.516037    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe8262ab-56cd-4d51-88bf-2f04bbb934e9-manifests\") pod \"opendatahub-operator-controller-manager-87c9445c4-g6msx\" (UID: \"fe8262ab-56cd-4d51-88bf-2f04bbb934e9\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.516248 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.516070    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe8262ab-56cd-4d51-88bf-2f04bbb934e9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87c9445c4-g6msx\" (UID: \"fe8262ab-56cd-4d51-88bf-2f04bbb934e9\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.516248 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.516088    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxnp6\" (UniqueName: \"kubernetes.io/projected/fe8262ab-56cd-4d51-88bf-2f04bbb934e9-kube-api-access-pxnp6\") pod \"opendatahub-operator-controller-manager-87c9445c4-g6msx\" (UID: \"fe8262ab-56cd-4d51-88bf-2f04bbb934e9\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.516248 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.516136    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe8262ab-56cd-4d51-88bf-2f04bbb934e9-tmp\") pod \"opendatahub-operator-controller-manager-87c9445c4-g6msx\" (UID: \"fe8262ab-56cd-4d51-88bf-2f04bbb934e9\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.617620 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.617541    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe8262ab-56cd-4d51-88bf-2f04bbb934e9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87c9445c4-g6msx\" (UID: \"fe8262ab-56cd-4d51-88bf-2f04bbb934e9\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.617620 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.617578    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxnp6\" (UniqueName: \"kubernetes.io/projected/fe8262ab-56cd-4d51-88bf-2f04bbb934e9-kube-api-access-pxnp6\") pod \"opendatahub-operator-controller-manager-87c9445c4-g6msx\" (UID: \"fe8262ab-56cd-4d51-88bf-2f04bbb934e9\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.617620 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.617604    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe8262ab-56cd-4d51-88bf-2f04bbb934e9-tmp\") pod \"opendatahub-operator-controller-manager-87c9445c4-g6msx\" (UID: \"fe8262ab-56cd-4d51-88bf-2f04bbb934e9\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.617880 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.617684    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe8262ab-56cd-4d51-88bf-2f04bbb934e9-webhook-cert\") pod \"opendatahub-operator-controller-manager-87c9445c4-g6msx\" (UID: \"fe8262ab-56cd-4d51-88bf-2f04bbb934e9\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.617880 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.617717    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe8262ab-56cd-4d51-88bf-2f04bbb934e9-manifests\") pod \"opendatahub-operator-controller-manager-87c9445c4-g6msx\" (UID: \"fe8262ab-56cd-4d51-88bf-2f04bbb934e9\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.618146 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.618118    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fe8262ab-56cd-4d51-88bf-2f04bbb934e9-manifests\") pod \"opendatahub-operator-controller-manager-87c9445c4-g6msx\" (UID: \"fe8262ab-56cd-4d51-88bf-2f04bbb934e9\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.620087 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.620057    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe8262ab-56cd-4d51-88bf-2f04bbb934e9-tmp\") pod \"opendatahub-operator-controller-manager-87c9445c4-g6msx\" (UID: \"fe8262ab-56cd-4d51-88bf-2f04bbb934e9\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.620189 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.620172    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fe8262ab-56cd-4d51-88bf-2f04bbb934e9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87c9445c4-g6msx\" (UID: \"fe8262ab-56cd-4d51-88bf-2f04bbb934e9\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.620252 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.620235    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe8262ab-56cd-4d51-88bf-2f04bbb934e9-webhook-cert\") pod \"opendatahub-operator-controller-manager-87c9445c4-g6msx\" (UID: \"fe8262ab-56cd-4d51-88bf-2f04bbb934e9\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.641228 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.641202    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxnp6\" (UniqueName: \"kubernetes.io/projected/fe8262ab-56cd-4d51-88bf-2f04bbb934e9-kube-api-access-pxnp6\") pod \"opendatahub-operator-controller-manager-87c9445c4-g6msx\" (UID: \"fe8262ab-56cd-4d51-88bf-2f04bbb934e9\") " pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.664090 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.664066    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:48.817694 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:48.817667    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"]
Jul 21 16:32:48.818277 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:32:48.818254    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe8262ab_56cd_4d51_88bf_2f04bbb934e9.slice/crio-4b3812a91d475fd9ef6ed18f03c119b34931b76da123046df3da51502a5af209 WatchSource:0}: Error finding container 4b3812a91d475fd9ef6ed18f03c119b34931b76da123046df3da51502a5af209: Status 404 returned error can't find the container with id 4b3812a91d475fd9ef6ed18f03c119b34931b76da123046df3da51502a5af209
Jul 21 16:32:49.329258 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:49.329223    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx" event={"ID":"fe8262ab-56cd-4d51-88bf-2f04bbb934e9","Type":"ContainerStarted","Data":"4b3812a91d475fd9ef6ed18f03c119b34931b76da123046df3da51502a5af209"}
Jul 21 16:32:54.353120 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:54.353037    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx" event={"ID":"fe8262ab-56cd-4d51-88bf-2f04bbb934e9","Type":"ContainerStarted","Data":"454b77e6477f608108ef0539867be925a3c5bf00770c51d8a017833805d944de"}
Jul 21 16:32:55.362047 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:55.362012    2524 generic.go:356] "Generic (PLEG): container finished" podID="fe8262ab-56cd-4d51-88bf-2f04bbb934e9" containerID="454b77e6477f608108ef0539867be925a3c5bf00770c51d8a017833805d944de" exitCode=0
Jul 21 16:32:55.362411 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:55.362115    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx" event={"ID":"fe8262ab-56cd-4d51-88bf-2f04bbb934e9","Type":"ContainerDied","Data":"454b77e6477f608108ef0539867be925a3c5bf00770c51d8a017833805d944de"}
Jul 21 16:32:58.378501 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:58.378420    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx" event={"ID":"fe8262ab-56cd-4d51-88bf-2f04bbb934e9","Type":"ContainerStarted","Data":"f71d2ea76be7639a89e3c8104e4d96dea41f2bb89f3b04ad9f2ed272a36d4ea7"}
Jul 21 16:32:58.378854 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:58.378554    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:32:58.402920 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:32:58.402878    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx" podStartSLOduration=1.3814276109999999 podStartE2EDuration="10.402862414s" totalImagesPullingTime="7.93854703s" totalInitContainerRuntime="1.082887773s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:58.400468428 +0000 UTC m=+278.796699209" watchObservedRunningTime="2026-07-21 16:32:58.402862414 +0000 UTC m=+278.799093194"
Jul 21 16:33:09.385296 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:09.385261    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-87c9445c4-g6msx"
Jul 21 16:33:11.643920 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.643889    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz"]
Jul 21 16:33:11.646773 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.646757    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz"
Jul 21 16:33:11.650903 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.650884    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 21 16:33:11.651014 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.650925    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 16:33:11.651196 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.651183    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7rslk\""
Jul 21 16:33:11.651250 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.651185    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 16:33:11.651778 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.651762    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 16:33:11.671081 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.671052    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz"]
Jul 21 16:33:11.780871 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.780848    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gmcw\" (UniqueName: \"kubernetes.io/projected/f1dcecd2-3bd2-4287-a6ef-235681541284-kube-api-access-5gmcw\") pod \"kube-auth-proxy-7d77f95f8-6hhsz\" (UID: \"f1dcecd2-3bd2-4287-a6ef-235681541284\") " pod="openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz"
Jul 21 16:33:11.780984 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.780899    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1dcecd2-3bd2-4287-a6ef-235681541284-tmp\") pod \"kube-auth-proxy-7d77f95f8-6hhsz\" (UID: \"f1dcecd2-3bd2-4287-a6ef-235681541284\") " pod="openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz"
Jul 21 16:33:11.780984 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.780958    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1dcecd2-3bd2-4287-a6ef-235681541284-tls-certs\") pod \"kube-auth-proxy-7d77f95f8-6hhsz\" (UID: \"f1dcecd2-3bd2-4287-a6ef-235681541284\") " pod="openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz"
Jul 21 16:33:11.882045 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.882019    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1dcecd2-3bd2-4287-a6ef-235681541284-tmp\") pod \"kube-auth-proxy-7d77f95f8-6hhsz\" (UID: \"f1dcecd2-3bd2-4287-a6ef-235681541284\") " pod="openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz"
Jul 21 16:33:11.882127 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.882064    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1dcecd2-3bd2-4287-a6ef-235681541284-tls-certs\") pod \"kube-auth-proxy-7d77f95f8-6hhsz\" (UID: \"f1dcecd2-3bd2-4287-a6ef-235681541284\") " pod="openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz"
Jul 21 16:33:11.882127 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.882120    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gmcw\" (UniqueName: \"kubernetes.io/projected/f1dcecd2-3bd2-4287-a6ef-235681541284-kube-api-access-5gmcw\") pod \"kube-auth-proxy-7d77f95f8-6hhsz\" (UID: \"f1dcecd2-3bd2-4287-a6ef-235681541284\") " pod="openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz"
Jul 21 16:33:11.884499 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.884472    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1dcecd2-3bd2-4287-a6ef-235681541284-tmp\") pod \"kube-auth-proxy-7d77f95f8-6hhsz\" (UID: \"f1dcecd2-3bd2-4287-a6ef-235681541284\") " pod="openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz"
Jul 21 16:33:11.884714 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.884697    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1dcecd2-3bd2-4287-a6ef-235681541284-tls-certs\") pod \"kube-auth-proxy-7d77f95f8-6hhsz\" (UID: \"f1dcecd2-3bd2-4287-a6ef-235681541284\") " pod="openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz"
Jul 21 16:33:11.912428 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.912373    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gmcw\" (UniqueName: \"kubernetes.io/projected/f1dcecd2-3bd2-4287-a6ef-235681541284-kube-api-access-5gmcw\") pod \"kube-auth-proxy-7d77f95f8-6hhsz\" (UID: \"f1dcecd2-3bd2-4287-a6ef-235681541284\") " pod="openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz"
Jul 21 16:33:11.956245 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:11.956215    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz"
Jul 21 16:33:12.010967 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:12.010943    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gps9z"]
Jul 21 16:33:12.014554 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:12.014496    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gps9z"
Jul 21 16:33:12.019563 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:12.019277    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 21 16:33:12.019563 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:12.019340    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-x2qdc\""
Jul 21 16:33:12.030446 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:12.030397    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gps9z"]
Jul 21 16:33:12.111752 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:12.111722    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz"]
Jul 21 16:33:12.115272 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:33:12.115233    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1dcecd2_3bd2_4287_a6ef_235681541284.slice/crio-d1bf010554ef3c0ec02595a7241717afbae60d6db15203e3ce76d380e7ba7820 WatchSource:0}: Error finding container d1bf010554ef3c0ec02595a7241717afbae60d6db15203e3ce76d380e7ba7820: Status 404 returned error can't find the container with id d1bf010554ef3c0ec02595a7241717afbae60d6db15203e3ce76d380e7ba7820
Jul 21 16:33:12.185193 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:12.185139    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwpg9\" (UniqueName: \"kubernetes.io/projected/8bd2cae8-19f9-4921-9d50-3227f565d372-kube-api-access-vwpg9\") pod \"odh-model-controller-7998c67dc4-gps9z\" (UID: \"8bd2cae8-19f9-4921-9d50-3227f565d372\") " pod="opendatahub/odh-model-controller-7998c67dc4-gps9z"
Jul 21 16:33:12.185193 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:12.185175    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bd2cae8-19f9-4921-9d50-3227f565d372-cert\") pod \"odh-model-controller-7998c67dc4-gps9z\" (UID: \"8bd2cae8-19f9-4921-9d50-3227f565d372\") " pod="opendatahub/odh-model-controller-7998c67dc4-gps9z"
Jul 21 16:33:12.285731 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:12.285711    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bd2cae8-19f9-4921-9d50-3227f565d372-cert\") pod \"odh-model-controller-7998c67dc4-gps9z\" (UID: \"8bd2cae8-19f9-4921-9d50-3227f565d372\") " pod="opendatahub/odh-model-controller-7998c67dc4-gps9z"
Jul 21 16:33:12.285859 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:12.285801    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwpg9\" (UniqueName: \"kubernetes.io/projected/8bd2cae8-19f9-4921-9d50-3227f565d372-kube-api-access-vwpg9\") pod \"odh-model-controller-7998c67dc4-gps9z\" (UID: \"8bd2cae8-19f9-4921-9d50-3227f565d372\") " pod="opendatahub/odh-model-controller-7998c67dc4-gps9z"
Jul 21 16:33:12.285922 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:33:12.285868    2524 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 21 16:33:12.285986 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:33:12.285939    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd2cae8-19f9-4921-9d50-3227f565d372-cert podName:8bd2cae8-19f9-4921-9d50-3227f565d372 nodeName:}" failed. No retries permitted until 2026-07-21 16:33:12.78591813 +0000 UTC m=+293.182148907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8bd2cae8-19f9-4921-9d50-3227f565d372-cert") pod "odh-model-controller-7998c67dc4-gps9z" (UID: "8bd2cae8-19f9-4921-9d50-3227f565d372") : secret "odh-model-controller-webhook-cert" not found
Jul 21 16:33:12.307033 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:12.307008    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwpg9\" (UniqueName: \"kubernetes.io/projected/8bd2cae8-19f9-4921-9d50-3227f565d372-kube-api-access-vwpg9\") pod \"odh-model-controller-7998c67dc4-gps9z\" (UID: \"8bd2cae8-19f9-4921-9d50-3227f565d372\") " pod="opendatahub/odh-model-controller-7998c67dc4-gps9z"
Jul 21 16:33:12.449559 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:12.449472    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz" event={"ID":"f1dcecd2-3bd2-4287-a6ef-235681541284","Type":"ContainerStarted","Data":"d1bf010554ef3c0ec02595a7241717afbae60d6db15203e3ce76d380e7ba7820"}
Jul 21 16:33:12.789383 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:12.789344    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bd2cae8-19f9-4921-9d50-3227f565d372-cert\") pod \"odh-model-controller-7998c67dc4-gps9z\" (UID: \"8bd2cae8-19f9-4921-9d50-3227f565d372\") " pod="opendatahub/odh-model-controller-7998c67dc4-gps9z"
Jul 21 16:33:12.792127 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:12.792104    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bd2cae8-19f9-4921-9d50-3227f565d372-cert\") pod \"odh-model-controller-7998c67dc4-gps9z\" (UID: \"8bd2cae8-19f9-4921-9d50-3227f565d372\") " pod="opendatahub/odh-model-controller-7998c67dc4-gps9z"
Jul 21 16:33:12.927788 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:12.927760    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gps9z"
Jul 21 16:33:13.118832 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:33:13.118804    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd2cae8_19f9_4921_9d50_3227f565d372.slice/crio-bc2dccb87c4acee431e10c4179d35206ce5201f9f3ae143b6b8d39fef4ed4a8f WatchSource:0}: Error finding container bc2dccb87c4acee431e10c4179d35206ce5201f9f3ae143b6b8d39fef4ed4a8f: Status 404 returned error can't find the container with id bc2dccb87c4acee431e10c4179d35206ce5201f9f3ae143b6b8d39fef4ed4a8f
Jul 21 16:33:13.128612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:13.128582    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gps9z"]
Jul 21 16:33:13.456756 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:13.456675    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gps9z" event={"ID":"8bd2cae8-19f9-4921-9d50-3227f565d372","Type":"ContainerStarted","Data":"bc2dccb87c4acee431e10c4179d35206ce5201f9f3ae143b6b8d39fef4ed4a8f"}
Jul 21 16:33:13.618089 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:13.618055    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cqqhm"]
Jul 21 16:33:13.622353 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:13.622325    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cqqhm"
Jul 21 16:33:13.631773 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:13.631546    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hl99j\""
Jul 21 16:33:13.632175 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:13.631903    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 21 16:33:13.646952 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:13.646927    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cqqhm"]
Jul 21 16:33:13.696806 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:13.696762    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfvph\" (UniqueName: \"kubernetes.io/projected/170a0bc5-278a-4cb7-bd6d-36e237d70a71-kube-api-access-gfvph\") pod \"model-serving-api-54d89bd5fc-cqqhm\" (UID: \"170a0bc5-278a-4cb7-bd6d-36e237d70a71\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqqhm"
Jul 21 16:33:13.696952 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:13.696833    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/170a0bc5-278a-4cb7-bd6d-36e237d70a71-tls-certs\") pod \"model-serving-api-54d89bd5fc-cqqhm\" (UID: \"170a0bc5-278a-4cb7-bd6d-36e237d70a71\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqqhm"
Jul 21 16:33:13.798857 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:13.798661    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfvph\" (UniqueName: \"kubernetes.io/projected/170a0bc5-278a-4cb7-bd6d-36e237d70a71-kube-api-access-gfvph\") pod \"model-serving-api-54d89bd5fc-cqqhm\" (UID: \"170a0bc5-278a-4cb7-bd6d-36e237d70a71\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqqhm"
Jul 21 16:33:13.799292 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:13.799215    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/170a0bc5-278a-4cb7-bd6d-36e237d70a71-tls-certs\") pod \"model-serving-api-54d89bd5fc-cqqhm\" (UID: \"170a0bc5-278a-4cb7-bd6d-36e237d70a71\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqqhm"
Jul 21 16:33:13.801728 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:13.801696    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/170a0bc5-278a-4cb7-bd6d-36e237d70a71-tls-certs\") pod \"model-serving-api-54d89bd5fc-cqqhm\" (UID: \"170a0bc5-278a-4cb7-bd6d-36e237d70a71\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqqhm"
Jul 21 16:33:13.813230 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:13.813200    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfvph\" (UniqueName: \"kubernetes.io/projected/170a0bc5-278a-4cb7-bd6d-36e237d70a71-kube-api-access-gfvph\") pod \"model-serving-api-54d89bd5fc-cqqhm\" (UID: \"170a0bc5-278a-4cb7-bd6d-36e237d70a71\") " pod="opendatahub/model-serving-api-54d89bd5fc-cqqhm"
Jul 21 16:33:13.937031 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:13.937001    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cqqhm"
Jul 21 16:33:14.337557 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.337522    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"]
Jul 21 16:33:14.341955 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.341327    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.348948 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.348922    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 21 16:33:14.350999 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.350764    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 21 16:33:14.350999 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.350762    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 21 16:33:14.356444 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.356261    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 16:33:14.359252 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.359232    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xsjzj\""
Jul 21 16:33:14.381061 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.381004    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"]
Jul 21 16:33:14.405947 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.405921    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-cacerts\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.406101 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.405986    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.406101 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.406036    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.406101 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.406078    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12945bc4-7adb-4bf8-ba81-3c880c0e9758-local-certs\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.406263 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.406105    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-token\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.406263 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.406143    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhbb5\" (UniqueName: \"kubernetes.io/projected/12945bc4-7adb-4bf8-ba81-3c880c0e9758-kube-api-access-zhbb5\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.406263 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.406173    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.506912 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.506882    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhbb5\" (UniqueName: \"kubernetes.io/projected/12945bc4-7adb-4bf8-ba81-3c880c0e9758-kube-api-access-zhbb5\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.507079 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.506922    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.507079 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.506978    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-cacerts\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.507079 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.507019    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.507079 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.507064    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.507294 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.507106    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12945bc4-7adb-4bf8-ba81-3c880c0e9758-local-certs\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.507294 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.507131    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-token\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.507741 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.507712    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.509969 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.509940    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.510159 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.510107    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-cacerts\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.510159 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.510127    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12945bc4-7adb-4bf8-ba81-3c880c0e9758-local-certs\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.510285 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.510215    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.538920 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.538885    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhbb5\" (UniqueName: \"kubernetes.io/projected/12945bc4-7adb-4bf8-ba81-3c880c0e9758-kube-api-access-zhbb5\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.539554 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.539531    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-token\") pod \"istiod-openshift-gateway-7574459656-5kh7f\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:14.655354 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:14.655280    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:16.073869 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:16.073840    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"]
Jul 21 16:33:16.074424 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:33:16.074397    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12945bc4_7adb_4bf8_ba81_3c880c0e9758.slice/crio-df42b7a03c884f87d3848b0a7f86185e3744d0dd35480dae1156fcf3639dc5ee WatchSource:0}: Error finding container df42b7a03c884f87d3848b0a7f86185e3744d0dd35480dae1156fcf3639dc5ee: Status 404 returned error can't find the container with id df42b7a03c884f87d3848b0a7f86185e3744d0dd35480dae1156fcf3639dc5ee
Jul 21 16:33:16.095550 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:16.095527    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cqqhm"]
Jul 21 16:33:16.097472 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:33:16.097446    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170a0bc5_278a_4cb7_bd6d_36e237d70a71.slice/crio-e263162c70259aa1d7b2ce954a33fbb29bd451cc0fc3528aae6a8babe59faa1c WatchSource:0}: Error finding container e263162c70259aa1d7b2ce954a33fbb29bd451cc0fc3528aae6a8babe59faa1c: Status 404 returned error can't find the container with id e263162c70259aa1d7b2ce954a33fbb29bd451cc0fc3528aae6a8babe59faa1c
Jul 21 16:33:16.474602 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:16.474568    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz" event={"ID":"f1dcecd2-3bd2-4287-a6ef-235681541284","Type":"ContainerStarted","Data":"b69ae0bf7437cb542ee1981b5dffc992f68663557bd75eb86704ec471fc9e10f"}
Jul 21 16:33:16.476080 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:16.476051    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gps9z" event={"ID":"8bd2cae8-19f9-4921-9d50-3227f565d372","Type":"ContainerStarted","Data":"64bdba25399292fd5b0eb13754d0bf82c5de4278cef1cb1cc18d66844cc2c08a"}
Jul 21 16:33:16.476210 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:16.476152    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-gps9z"
Jul 21 16:33:16.477174 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:16.477154    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cqqhm" event={"ID":"170a0bc5-278a-4cb7-bd6d-36e237d70a71","Type":"ContainerStarted","Data":"e263162c70259aa1d7b2ce954a33fbb29bd451cc0fc3528aae6a8babe59faa1c"}
Jul 21 16:33:16.478276 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:16.478255    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f" event={"ID":"12945bc4-7adb-4bf8-ba81-3c880c0e9758","Type":"ContainerStarted","Data":"df42b7a03c884f87d3848b0a7f86185e3744d0dd35480dae1156fcf3639dc5ee"}
Jul 21 16:33:16.493826 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:16.493786    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d77f95f8-6hhsz" podStartSLOduration=1.698776434 podStartE2EDuration="5.493773545s" totalImagesPullingTime="3.794997111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:16.492245985 +0000 UTC m=+296.888476776" watchObservedRunningTime="2026-07-21 16:33:16.493773545 +0000 UTC m=+296.890004326"
Jul 21 16:33:16.511393 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:16.511347    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-gps9z" podStartSLOduration=2.67023871 podStartE2EDuration="5.511333348s" totalImagesPullingTime="2.841094638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:16.510155417 +0000 UTC m=+296.906386199" watchObservedRunningTime="2026-07-21 16:33:16.511333348 +0000 UTC m=+296.907564127"
Jul 21 16:33:18.498706 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:18.498671    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cqqhm" event={"ID":"170a0bc5-278a-4cb7-bd6d-36e237d70a71","Type":"ContainerStarted","Data":"6d870f109316567925c776b641db07b994c1113ba3afca414c7f8215132688aa"}
Jul 21 16:33:18.499170 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:18.498761    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-cqqhm"
Jul 21 16:33:18.532438 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:18.532319    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-cqqhm" podStartSLOduration=4.163199363 podStartE2EDuration="5.532297344s" totalImagesPullingTime="1.369097981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:18.528863801 +0000 UTC m=+298.925094583" watchObservedRunningTime="2026-07-21 16:33:18.532297344 +0000 UTC m=+298.928528127"
Jul 21 16:33:19.340444 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:19.340404    2524 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 21 16:33:19.340562 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:19.340471    2524 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 21 16:33:19.505187 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:19.505152    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f" event={"ID":"12945bc4-7adb-4bf8-ba81-3c880c0e9758","Type":"ContainerStarted","Data":"cf81fa43cfd4826a2048f25efd660981fd7b80a38592b6422f9574505c04eba7"}
Jul 21 16:33:19.505610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:19.505365    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:19.587610 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:19.587559    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f" podStartSLOduration=2.32382231 podStartE2EDuration="5.587544196s" totalImagesPullingTime="3.263721886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:19.584865592 +0000 UTC m=+299.981096374" watchObservedRunningTime="2026-07-21 16:33:19.587544196 +0000 UTC m=+299.983774992"
Jul 21 16:33:19.966827 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:19.966802    2524 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 16:33:20.511375 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:20.511340    2524 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-5kh7f container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 16:33:20.513780 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:20.511393    2524 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f" podUID="12945bc4-7adb-4bf8-ba81-3c880c0e9758" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 16:33:21.247459 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.247415    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"]
Jul 21 16:33:21.251005 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.250978    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.254467 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.254447    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-nqrnl\""
Jul 21 16:33:21.265062 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.265038    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65804d3f-c34e-4152-92f8-523d3be0d7d0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.265176 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.265066    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65804d3f-c34e-4152-92f8-523d3be0d7d0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.265176 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.265085    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65804d3f-c34e-4152-92f8-523d3be0d7d0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.265176 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.265102    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65804d3f-c34e-4152-92f8-523d3be0d7d0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.265357 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.265213    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65804d3f-c34e-4152-92f8-523d3be0d7d0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.265357 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.265258    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65804d3f-c34e-4152-92f8-523d3be0d7d0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.265357 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.265308    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65804d3f-c34e-4152-92f8-523d3be0d7d0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.265357 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.265351    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65804d3f-c34e-4152-92f8-523d3be0d7d0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.265538 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.265407    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bntt2\" (UniqueName: \"kubernetes.io/projected/65804d3f-c34e-4152-92f8-523d3be0d7d0-kube-api-access-bntt2\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.272990 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.272966    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"]
Jul 21 16:33:21.366752 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.366712    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65804d3f-c34e-4152-92f8-523d3be0d7d0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.366941 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.366767    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65804d3f-c34e-4152-92f8-523d3be0d7d0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.366941 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.366809    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65804d3f-c34e-4152-92f8-523d3be0d7d0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.366941 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.366848    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65804d3f-c34e-4152-92f8-523d3be0d7d0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.366941 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.366897    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65804d3f-c34e-4152-92f8-523d3be0d7d0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.366941 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.366932    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65804d3f-c34e-4152-92f8-523d3be0d7d0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.367213 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.366975    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65804d3f-c34e-4152-92f8-523d3be0d7d0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.367213 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.367038    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65804d3f-c34e-4152-92f8-523d3be0d7d0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.367213 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.367104    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bntt2\" (UniqueName: \"kubernetes.io/projected/65804d3f-c34e-4152-92f8-523d3be0d7d0-kube-api-access-bntt2\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.367213 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.367170    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65804d3f-c34e-4152-92f8-523d3be0d7d0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.367434 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.367240    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65804d3f-c34e-4152-92f8-523d3be0d7d0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.367434 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.367385    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65804d3f-c34e-4152-92f8-523d3be0d7d0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.367572 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.367534    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65804d3f-c34e-4152-92f8-523d3be0d7d0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.367752 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.367723    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65804d3f-c34e-4152-92f8-523d3be0d7d0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.369392 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.369374    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65804d3f-c34e-4152-92f8-523d3be0d7d0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.369864 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.369847    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65804d3f-c34e-4152-92f8-523d3be0d7d0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.395829 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.395804    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bntt2\" (UniqueName: \"kubernetes.io/projected/65804d3f-c34e-4152-92f8-523d3be0d7d0-kube-api-access-bntt2\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.405406 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.405376    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65804d3f-c34e-4152-92f8-523d3be0d7d0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4qdz2x\" (UID: \"65804d3f-c34e-4152-92f8-523d3be0d7d0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.562694 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.562665    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:21.827749 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.827674    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"]
Jul 21 16:33:21.832055 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:33:21.832026    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65804d3f_c34e_4152_92f8_523d3be0d7d0.slice/crio-87ac7ef998c30abc0e12f98b20c9577e224aaa325dff03b6e8c49ec9fba0fa36 WatchSource:0}: Error finding container 87ac7ef998c30abc0e12f98b20c9577e224aaa325dff03b6e8c49ec9fba0fa36: Status 404 returned error can't find the container with id 87ac7ef998c30abc0e12f98b20c9577e224aaa325dff03b6e8c49ec9fba0fa36
Jul 21 16:33:21.833930 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:21.833914    2524 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:33:22.526178 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:22.526142    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x" event={"ID":"65804d3f-c34e-4152-92f8-523d3be0d7d0","Type":"ContainerStarted","Data":"87ac7ef998c30abc0e12f98b20c9577e224aaa325dff03b6e8c49ec9fba0fa36"}
Jul 21 16:33:23.510785 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.510751    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:23.523102 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.523075    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-svvfk"]
Jul 21 16:33:23.527816 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.527798    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-svvfk"
Jul 21 16:33:23.536749 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.536728    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 21 16:33:23.537143 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.537128    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5hg5v\""
Jul 21 16:33:23.556849 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.556832    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-svvfk"]
Jul 21 16:33:23.573309 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.573287    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94"]
Jul 21 16:33:23.576601 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.576577    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94"
Jul 21 16:33:23.583715 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.583681    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hjgnz\""
Jul 21 16:33:23.584816 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.584790    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 21 16:33:23.585947 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.585926    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ljbd\" (UniqueName: \"kubernetes.io/projected/db6084af-9742-46a8-9e77-7e88980bf63a-kube-api-access-2ljbd\") pod \"kserve-controller-manager-d6f4b65b8-svvfk\" (UID: \"db6084af-9742-46a8-9e77-7e88980bf63a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-svvfk"
Jul 21 16:33:23.586117 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.586097    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db6084af-9742-46a8-9e77-7e88980bf63a-cert\") pod \"kserve-controller-manager-d6f4b65b8-svvfk\" (UID: \"db6084af-9742-46a8-9e77-7e88980bf63a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-svvfk"
Jul 21 16:33:23.617988 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.617957    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94"]
Jul 21 16:33:23.686710 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.686669    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ljbd\" (UniqueName: \"kubernetes.io/projected/db6084af-9742-46a8-9e77-7e88980bf63a-kube-api-access-2ljbd\") pod \"kserve-controller-manager-d6f4b65b8-svvfk\" (UID: \"db6084af-9742-46a8-9e77-7e88980bf63a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-svvfk"
Jul 21 16:33:23.686856 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.686718    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85d31a95-be9f-4a27-9697-c8d8ba0adb09-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4wj94\" (UID: \"85d31a95-be9f-4a27-9697-c8d8ba0adb09\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94"
Jul 21 16:33:23.686856 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.686759    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zqxm\" (UniqueName: \"kubernetes.io/projected/85d31a95-be9f-4a27-9697-c8d8ba0adb09-kube-api-access-9zqxm\") pod \"llmisvc-controller-manager-777c6bd7d5-4wj94\" (UID: \"85d31a95-be9f-4a27-9697-c8d8ba0adb09\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94"
Jul 21 16:33:23.686927 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.686867    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db6084af-9742-46a8-9e77-7e88980bf63a-cert\") pod \"kserve-controller-manager-d6f4b65b8-svvfk\" (UID: \"db6084af-9742-46a8-9e77-7e88980bf63a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-svvfk"
Jul 21 16:33:23.687018 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:33:23.687001    2524 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 21 16:33:23.687082 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:33:23.687072    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db6084af-9742-46a8-9e77-7e88980bf63a-cert podName:db6084af-9742-46a8-9e77-7e88980bf63a nodeName:}" failed. No retries permitted until 2026-07-21 16:33:24.187055251 +0000 UTC m=+304.583286009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/db6084af-9742-46a8-9e77-7e88980bf63a-cert") pod "kserve-controller-manager-d6f4b65b8-svvfk" (UID: "db6084af-9742-46a8-9e77-7e88980bf63a") : secret "kserve-webhook-server-cert" not found
Jul 21 16:33:23.711983 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.711960    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ljbd\" (UniqueName: \"kubernetes.io/projected/db6084af-9742-46a8-9e77-7e88980bf63a-kube-api-access-2ljbd\") pod \"kserve-controller-manager-d6f4b65b8-svvfk\" (UID: \"db6084af-9742-46a8-9e77-7e88980bf63a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-svvfk"
Jul 21 16:33:23.788325 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.788293    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85d31a95-be9f-4a27-9697-c8d8ba0adb09-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4wj94\" (UID: \"85d31a95-be9f-4a27-9697-c8d8ba0adb09\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94"
Jul 21 16:33:23.788488 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.788346    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zqxm\" (UniqueName: \"kubernetes.io/projected/85d31a95-be9f-4a27-9697-c8d8ba0adb09-kube-api-access-9zqxm\") pod \"llmisvc-controller-manager-777c6bd7d5-4wj94\" (UID: \"85d31a95-be9f-4a27-9697-c8d8ba0adb09\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94"
Jul 21 16:33:23.788488 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:33:23.788470    2524 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 21 16:33:23.788628 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:33:23.788560    2524 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d31a95-be9f-4a27-9697-c8d8ba0adb09-cert podName:85d31a95-be9f-4a27-9697-c8d8ba0adb09 nodeName:}" failed. No retries permitted until 2026-07-21 16:33:24.28853912 +0000 UTC m=+304.684769892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/85d31a95-be9f-4a27-9697-c8d8ba0adb09-cert") pod "llmisvc-controller-manager-777c6bd7d5-4wj94" (UID: "85d31a95-be9f-4a27-9697-c8d8ba0adb09") : secret "llmisvc-webhook-server-cert" not found
Jul 21 16:33:23.811637 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:23.811617    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zqxm\" (UniqueName: \"kubernetes.io/projected/85d31a95-be9f-4a27-9697-c8d8ba0adb09-kube-api-access-9zqxm\") pod \"llmisvc-controller-manager-777c6bd7d5-4wj94\" (UID: \"85d31a95-be9f-4a27-9697-c8d8ba0adb09\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94"
Jul 21 16:33:24.191708 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:24.191631    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db6084af-9742-46a8-9e77-7e88980bf63a-cert\") pod \"kserve-controller-manager-d6f4b65b8-svvfk\" (UID: \"db6084af-9742-46a8-9e77-7e88980bf63a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-svvfk"
Jul 21 16:33:24.194662 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:24.194636    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db6084af-9742-46a8-9e77-7e88980bf63a-cert\") pod \"kserve-controller-manager-d6f4b65b8-svvfk\" (UID: \"db6084af-9742-46a8-9e77-7e88980bf63a\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-svvfk"
Jul 21 16:33:24.292974 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:24.292936    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85d31a95-be9f-4a27-9697-c8d8ba0adb09-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4wj94\" (UID: \"85d31a95-be9f-4a27-9697-c8d8ba0adb09\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94"
Jul 21 16:33:24.296064 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:24.296042    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85d31a95-be9f-4a27-9697-c8d8ba0adb09-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4wj94\" (UID: \"85d31a95-be9f-4a27-9697-c8d8ba0adb09\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94"
Jul 21 16:33:24.438649 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:24.438616    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-svvfk"
Jul 21 16:33:24.488358 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:24.488322    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94"
Jul 21 16:33:24.702499 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:24.701791    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-svvfk"]
Jul 21 16:33:24.710156 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:33:24.710127    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb6084af_9742_46a8_9e77_7e88980bf63a.slice/crio-3d3e924aa6f9c72a66c84b4dcfc00eef95be1386e4fe7d9fef1ed7b269aacb60 WatchSource:0}: Error finding container 3d3e924aa6f9c72a66c84b4dcfc00eef95be1386e4fe7d9fef1ed7b269aacb60: Status 404 returned error can't find the container with id 3d3e924aa6f9c72a66c84b4dcfc00eef95be1386e4fe7d9fef1ed7b269aacb60
Jul 21 16:33:24.776705 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:24.776677    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94"]
Jul 21 16:33:24.779176 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:33:24.779150    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod85d31a95_be9f_4a27_9697_c8d8ba0adb09.slice/crio-c2c81669a59809b0a59a0ecaa5eb2a537bedd498c47b422f454681693c21c125 WatchSource:0}: Error finding container c2c81669a59809b0a59a0ecaa5eb2a537bedd498c47b422f454681693c21c125: Status 404 returned error can't find the container with id c2c81669a59809b0a59a0ecaa5eb2a537bedd498c47b422f454681693c21c125
Jul 21 16:33:25.546580 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:25.546540    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-svvfk" event={"ID":"db6084af-9742-46a8-9e77-7e88980bf63a","Type":"ContainerStarted","Data":"3d3e924aa6f9c72a66c84b4dcfc00eef95be1386e4fe7d9fef1ed7b269aacb60"}
Jul 21 16:33:25.548019 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:25.547993    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94" event={"ID":"85d31a95-be9f-4a27-9697-c8d8ba0adb09","Type":"ContainerStarted","Data":"c2c81669a59809b0a59a0ecaa5eb2a537bedd498c47b422f454681693c21c125"}
Jul 21 16:33:25.901577 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:25.901541    2524 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 21 16:33:25.901882 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:25.901611    2524 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 21 16:33:25.901882 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:25.901638    2524 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 21 16:33:26.556841 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:26.556804    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x" event={"ID":"65804d3f-c34e-4152-92f8-523d3be0d7d0","Type":"ContainerStarted","Data":"c6db56461f0ab17f5083e592e4ba9b0fcc4a798e40cdb81943dbd5f97529b42a"}
Jul 21 16:33:26.563678 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:26.563656    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:26.570550 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:26.570467    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:26.638491 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:26.638437    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x" podStartSLOduration=1.571180092 podStartE2EDuration="5.638416655s" totalImagesPullingTime="4.067236563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:26.592727229 +0000 UTC m=+306.988958012" watchObservedRunningTime="2026-07-21 16:33:26.638416655 +0000 UTC m=+307.034647435"
Jul 21 16:33:27.485776 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:27.485746    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-gps9z"
Jul 21 16:33:27.564136 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:27.564105    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:27.565152 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:27.565123    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4qdz2x"
Jul 21 16:33:28.452235 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.452204    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"]
Jul 21 16:33:28.452422 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.452401    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f" podUID="12945bc4-7adb-4bf8-ba81-3c880c0e9758" containerName="discovery" containerID="cri-o://cf81fa43cfd4826a2048f25efd660981fd7b80a38592b6422f9574505c04eba7" gracePeriod=30
Jul 21 16:33:28.570250 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.570219    2524 generic.go:356] "Generic (PLEG): container finished" podID="12945bc4-7adb-4bf8-ba81-3c880c0e9758" containerID="cf81fa43cfd4826a2048f25efd660981fd7b80a38592b6422f9574505c04eba7" exitCode=0
Jul 21 16:33:28.570594 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.570286    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f" event={"ID":"12945bc4-7adb-4bf8-ba81-3c880c0e9758","Type":"ContainerDied","Data":"cf81fa43cfd4826a2048f25efd660981fd7b80a38592b6422f9574505c04eba7"}
Jul 21 16:33:28.571937 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.571903    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-svvfk" event={"ID":"db6084af-9742-46a8-9e77-7e88980bf63a","Type":"ContainerStarted","Data":"1de826beeb094435041e12960ee087d9bd31172a019b0dc139ba2ec8ad1a2b22"}
Jul 21 16:33:28.572127 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.572109    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-svvfk"
Jul 21 16:33:28.573490 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.573468    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94" event={"ID":"85d31a95-be9f-4a27-9697-c8d8ba0adb09","Type":"ContainerStarted","Data":"e2cc79511babdcdc508d0e670ffff075f94851668ba318ebdf3e6f0c5f7c9110"}
Jul 21 16:33:28.573674 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.573659    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94"
Jul 21 16:33:28.623637 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.623089    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-svvfk" podStartSLOduration=2.11290269 podStartE2EDuration="5.623069802s" totalImagesPullingTime="3.510167112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:33:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:28.62184836 +0000 UTC m=+309.018079165" watchObservedRunningTime="2026-07-21 16:33:28.623069802 +0000 UTC m=+309.019300585"
Jul 21 16:33:28.705154 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.705133    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:28.741416 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.741334    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94" podStartSLOduration=2.295525709 podStartE2EDuration="5.741317147s" totalImagesPullingTime="3.445791438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:33:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:28.651352319 +0000 UTC m=+309.047583099" watchObservedRunningTime="2026-07-21 16:33:28.741317147 +0000 UTC m=+309.137547937"
Jul 21 16:33:28.847391 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.847362    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12945bc4-7adb-4bf8-ba81-3c880c0e9758-local-certs\") pod \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") "
Jul 21 16:33:28.847576 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.847406    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-csr-ca-configmap\") pod \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") "
Jul 21 16:33:28.847576 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.847438    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-kubeconfig\") pod \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") "
Jul 21 16:33:28.847576 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.847475    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-token\") pod \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") "
Jul 21 16:33:28.847576 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.847524    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhbb5\" (UniqueName: \"kubernetes.io/projected/12945bc4-7adb-4bf8-ba81-3c880c0e9758-kube-api-access-zhbb5\") pod \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") "
Jul 21 16:33:28.847576 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.847559    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-csr-dns-cert\") pod \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") "
Jul 21 16:33:28.847830 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.847599    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-cacerts\") pod \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\" (UID: \"12945bc4-7adb-4bf8-ba81-3c880c0e9758\") "
Jul 21 16:33:28.847894 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.847857    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "12945bc4-7adb-4bf8-ba81-3c880c0e9758" (UID: "12945bc4-7adb-4bf8-ba81-3c880c0e9758"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:33:28.848175 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.848118    2524 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-csr-ca-configmap\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:33:28.849865 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.849835    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12945bc4-7adb-4bf8-ba81-3c880c0e9758-local-certs" (OuterVolumeSpecName: "local-certs") pod "12945bc4-7adb-4bf8-ba81-3c880c0e9758" (UID: "12945bc4-7adb-4bf8-ba81-3c880c0e9758"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:33:28.850061 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.850021    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "12945bc4-7adb-4bf8-ba81-3c880c0e9758" (UID: "12945bc4-7adb-4bf8-ba81-3c880c0e9758"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:33:28.850248 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.850218    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-token" (OuterVolumeSpecName: "istio-token") pod "12945bc4-7adb-4bf8-ba81-3c880c0e9758" (UID: "12945bc4-7adb-4bf8-ba81-3c880c0e9758"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:33:28.850337 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.850310    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12945bc4-7adb-4bf8-ba81-3c880c0e9758-kube-api-access-zhbb5" (OuterVolumeSpecName: "kube-api-access-zhbb5") pod "12945bc4-7adb-4bf8-ba81-3c880c0e9758" (UID: "12945bc4-7adb-4bf8-ba81-3c880c0e9758"). InnerVolumeSpecName "kube-api-access-zhbb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:33:28.850377 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.850365    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "12945bc4-7adb-4bf8-ba81-3c880c0e9758" (UID: "12945bc4-7adb-4bf8-ba81-3c880c0e9758"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:33:28.850668 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.850637    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-cacerts" (OuterVolumeSpecName: "cacerts") pod "12945bc4-7adb-4bf8-ba81-3c880c0e9758" (UID: "12945bc4-7adb-4bf8-ba81-3c880c0e9758"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:33:28.948646 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.948616    2524 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-token\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:33:28.948646 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.948643    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhbb5\" (UniqueName: \"kubernetes.io/projected/12945bc4-7adb-4bf8-ba81-3c880c0e9758-kube-api-access-zhbb5\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:33:28.948835 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.948656    2524 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-csr-dns-cert\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:33:28.948835 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.948670    2524 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-cacerts\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:33:28.948835 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.948683    2524 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12945bc4-7adb-4bf8-ba81-3c880c0e9758-local-certs\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:33:28.948835 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:28.948695    2524 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12945bc4-7adb-4bf8-ba81-3c880c0e9758-istio-kubeconfig\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:33:29.509271 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:29.509193    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-cqqhm"
Jul 21 16:33:29.580364 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:29.580337    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"
Jul 21 16:33:29.580849 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:29.580373    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f" event={"ID":"12945bc4-7adb-4bf8-ba81-3c880c0e9758","Type":"ContainerDied","Data":"df42b7a03c884f87d3848b0a7f86185e3744d0dd35480dae1156fcf3639dc5ee"}
Jul 21 16:33:29.580849 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:29.580429    2524 scope.go:117] "RemoveContainer" containerID="cf81fa43cfd4826a2048f25efd660981fd7b80a38592b6422f9574505c04eba7"
Jul 21 16:33:29.606111 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:29.606086    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"]
Jul 21 16:33:29.617153 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:29.617132    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5kh7f"]
Jul 21 16:33:30.059883 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:30.059859    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12945bc4-7adb-4bf8-ba81-3c880c0e9758" path="/var/lib/kubelet/pods/12945bc4-7adb-4bf8-ba81-3c880c0e9758/volumes"
Jul 21 16:33:59.582839 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:59.582810    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4wj94"
Jul 21 16:33:59.585660 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:33:59.585643    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-svvfk"
Jul 21 16:34:12.617649 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:12.617451    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g94r5"]
Jul 21 16:34:12.618084 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:12.617975    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12945bc4-7adb-4bf8-ba81-3c880c0e9758" containerName="discovery"
Jul 21 16:34:12.618084 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:12.617994    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="12945bc4-7adb-4bf8-ba81-3c880c0e9758" containerName="discovery"
Jul 21 16:34:12.618191 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:12.618102    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="12945bc4-7adb-4bf8-ba81-3c880c0e9758" containerName="discovery"
Jul 21 16:34:12.621055 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:12.621033    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g94r5"
Jul 21 16:34:12.624710 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:12.624676    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 16:34:12.624710 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:12.624683    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 16:34:12.624904 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:12.624718    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6glzg\""
Jul 21 16:34:12.630240 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:12.630218    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g94r5"]
Jul 21 16:34:12.772586 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:12.772549    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntq8x\" (UniqueName: \"kubernetes.io/projected/b8bcad78-657b-4001-8517-9dd07fa38573-kube-api-access-ntq8x\") pod \"kuadrant-operator-catalog-g94r5\" (UID: \"b8bcad78-657b-4001-8517-9dd07fa38573\") " pod="kuadrant-system/kuadrant-operator-catalog-g94r5"
Jul 21 16:34:12.873946 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:12.873874    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntq8x\" (UniqueName: \"kubernetes.io/projected/b8bcad78-657b-4001-8517-9dd07fa38573-kube-api-access-ntq8x\") pod \"kuadrant-operator-catalog-g94r5\" (UID: \"b8bcad78-657b-4001-8517-9dd07fa38573\") " pod="kuadrant-system/kuadrant-operator-catalog-g94r5"
Jul 21 16:34:12.882453 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:12.882432    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntq8x\" (UniqueName: \"kubernetes.io/projected/b8bcad78-657b-4001-8517-9dd07fa38573-kube-api-access-ntq8x\") pod \"kuadrant-operator-catalog-g94r5\" (UID: \"b8bcad78-657b-4001-8517-9dd07fa38573\") " pod="kuadrant-system/kuadrant-operator-catalog-g94r5"
Jul 21 16:34:12.932221 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:12.932198    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g94r5"
Jul 21 16:34:12.973580 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:12.973552    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g94r5"]
Jul 21 16:34:13.061002 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:13.060980    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g94r5"]
Jul 21 16:34:13.062776 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:34:13.062748    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8bcad78_657b_4001_8517_9dd07fa38573.slice/crio-3064456b6f6dde8e25b1c17db2de60c2e8a3a2d20f0176bca681669da007537b WatchSource:0}: Error finding container 3064456b6f6dde8e25b1c17db2de60c2e8a3a2d20f0176bca681669da007537b: Status 404 returned error can't find the container with id 3064456b6f6dde8e25b1c17db2de60c2e8a3a2d20f0176bca681669da007537b
Jul 21 16:34:13.182218 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:13.182161    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jq8l7"]
Jul 21 16:34:13.186489 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:13.186473    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jq8l7"
Jul 21 16:34:13.193812 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:13.193787    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jq8l7"]
Jul 21 16:34:13.277288 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:13.277265    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgdfg\" (UniqueName: \"kubernetes.io/projected/1ff36980-7927-45fd-8948-9724f58d9c07-kube-api-access-jgdfg\") pod \"kuadrant-operator-catalog-jq8l7\" (UID: \"1ff36980-7927-45fd-8948-9724f58d9c07\") " pod="kuadrant-system/kuadrant-operator-catalog-jq8l7"
Jul 21 16:34:13.378638 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:13.378614    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgdfg\" (UniqueName: \"kubernetes.io/projected/1ff36980-7927-45fd-8948-9724f58d9c07-kube-api-access-jgdfg\") pod \"kuadrant-operator-catalog-jq8l7\" (UID: \"1ff36980-7927-45fd-8948-9724f58d9c07\") " pod="kuadrant-system/kuadrant-operator-catalog-jq8l7"
Jul 21 16:34:13.392443 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:13.392421    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgdfg\" (UniqueName: \"kubernetes.io/projected/1ff36980-7927-45fd-8948-9724f58d9c07-kube-api-access-jgdfg\") pod \"kuadrant-operator-catalog-jq8l7\" (UID: \"1ff36980-7927-45fd-8948-9724f58d9c07\") " pod="kuadrant-system/kuadrant-operator-catalog-jq8l7"
Jul 21 16:34:13.496482 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:13.496420    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jq8l7"
Jul 21 16:34:13.624177 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:13.624155    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jq8l7"]
Jul 21 16:34:13.625678 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:34:13.625647    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ff36980_7927_45fd_8948_9724f58d9c07.slice/crio-60a6733969b0bf5de18f444fe13ac172d46cd3a31ff6f40f27893872042273a7 WatchSource:0}: Error finding container 60a6733969b0bf5de18f444fe13ac172d46cd3a31ff6f40f27893872042273a7: Status 404 returned error can't find the container with id 60a6733969b0bf5de18f444fe13ac172d46cd3a31ff6f40f27893872042273a7
Jul 21 16:34:13.789582 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:13.789546    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jq8l7" event={"ID":"1ff36980-7927-45fd-8948-9724f58d9c07","Type":"ContainerStarted","Data":"60a6733969b0bf5de18f444fe13ac172d46cd3a31ff6f40f27893872042273a7"}
Jul 21 16:34:13.790717 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:13.790696    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g94r5" event={"ID":"b8bcad78-657b-4001-8517-9dd07fa38573","Type":"ContainerStarted","Data":"3064456b6f6dde8e25b1c17db2de60c2e8a3a2d20f0176bca681669da007537b"}
Jul 21 16:34:15.804219 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:15.804185    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g94r5" event={"ID":"b8bcad78-657b-4001-8517-9dd07fa38573","Type":"ContainerStarted","Data":"9316a753122e4b896208043512042f5d98510df0b6f2f9dd36900c7cd0d73b20"}
Jul 21 16:34:15.804570 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:15.804250    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-g94r5" podUID="b8bcad78-657b-4001-8517-9dd07fa38573" containerName="registry-server" containerID="cri-o://9316a753122e4b896208043512042f5d98510df0b6f2f9dd36900c7cd0d73b20" gracePeriod=2
Jul 21 16:34:15.820441 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:15.820401    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-g94r5" podStartSLOduration=1.149998128 podStartE2EDuration="3.820386088s" totalImagesPullingTime="2.67038796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:15.819266371 +0000 UTC m=+356.215497152" watchObservedRunningTime="2026-07-21 16:34:15.820386088 +0000 UTC m=+356.216616868"
Jul 21 16:34:16.045278 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.045249    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-g94r5_b8bcad78-657b-4001-8517-9dd07fa38573/registry-server/0.log"
Jul 21 16:34:16.048676 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.048661    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g94r5"
Jul 21 16:34:16.203569 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.203544    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntq8x\" (UniqueName: \"kubernetes.io/projected/b8bcad78-657b-4001-8517-9dd07fa38573-kube-api-access-ntq8x\") pod \"b8bcad78-657b-4001-8517-9dd07fa38573\" (UID: \"b8bcad78-657b-4001-8517-9dd07fa38573\") "
Jul 21 16:34:16.205723 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.205696    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8bcad78-657b-4001-8517-9dd07fa38573-kube-api-access-ntq8x" (OuterVolumeSpecName: "kube-api-access-ntq8x") pod "b8bcad78-657b-4001-8517-9dd07fa38573" (UID: "b8bcad78-657b-4001-8517-9dd07fa38573"). InnerVolumeSpecName "kube-api-access-ntq8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:34:16.304378 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.304328    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntq8x\" (UniqueName: \"kubernetes.io/projected/b8bcad78-657b-4001-8517-9dd07fa38573-kube-api-access-ntq8x\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:34:16.809697 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.809669    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jq8l7" event={"ID":"1ff36980-7927-45fd-8948-9724f58d9c07","Type":"ContainerStarted","Data":"95f6d57ba2cb9dfd4c228b8fac5e0e620df02e01421c38baa6a0462e84a9e8a9"}
Jul 21 16:34:16.810893 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.810876    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-g94r5_b8bcad78-657b-4001-8517-9dd07fa38573/registry-server/0.log"
Jul 21 16:34:16.810976 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.810913    2524 generic.go:356] "Generic (PLEG): container finished" podID="b8bcad78-657b-4001-8517-9dd07fa38573" containerID="9316a753122e4b896208043512042f5d98510df0b6f2f9dd36900c7cd0d73b20" exitCode=2
Jul 21 16:34:16.811015 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.810983    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g94r5"
Jul 21 16:34:16.811015 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.810999    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g94r5" event={"ID":"b8bcad78-657b-4001-8517-9dd07fa38573","Type":"ContainerDied","Data":"9316a753122e4b896208043512042f5d98510df0b6f2f9dd36900c7cd0d73b20"}
Jul 21 16:34:16.811115 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.811047    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g94r5" event={"ID":"b8bcad78-657b-4001-8517-9dd07fa38573","Type":"ContainerDied","Data":"3064456b6f6dde8e25b1c17db2de60c2e8a3a2d20f0176bca681669da007537b"}
Jul 21 16:34:16.811115 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.811069    2524 scope.go:117] "RemoveContainer" containerID="9316a753122e4b896208043512042f5d98510df0b6f2f9dd36900c7cd0d73b20"
Jul 21 16:34:16.819734 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.819720    2524 scope.go:117] "RemoveContainer" containerID="9316a753122e4b896208043512042f5d98510df0b6f2f9dd36900c7cd0d73b20"
Jul 21 16:34:16.819955 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:34:16.819937    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9316a753122e4b896208043512042f5d98510df0b6f2f9dd36900c7cd0d73b20\": container with ID starting with 9316a753122e4b896208043512042f5d98510df0b6f2f9dd36900c7cd0d73b20 not found: ID does not exist" containerID="9316a753122e4b896208043512042f5d98510df0b6f2f9dd36900c7cd0d73b20"
Jul 21 16:34:16.820013 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.819968    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9316a753122e4b896208043512042f5d98510df0b6f2f9dd36900c7cd0d73b20"} err="failed to get container status \"9316a753122e4b896208043512042f5d98510df0b6f2f9dd36900c7cd0d73b20\": rpc error: code = NotFound desc = could not find container \"9316a753122e4b896208043512042f5d98510df0b6f2f9dd36900c7cd0d73b20\": container with ID starting with 9316a753122e4b896208043512042f5d98510df0b6f2f9dd36900c7cd0d73b20 not found: ID does not exist"
Jul 21 16:34:16.847341 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.847297    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jq8l7" podStartSLOduration=1.612779551 podStartE2EDuration="3.847283458s" totalImagesPullingTime="2.234503907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:16.84619509 +0000 UTC m=+357.242425894" watchObservedRunningTime="2026-07-21 16:34:16.847283458 +0000 UTC m=+357.243514237"
Jul 21 16:34:16.868183 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.868159    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g94r5"]
Jul 21 16:34:16.875355 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:16.875331    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g94r5"]
Jul 21 16:34:18.064354 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:18.064325    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8bcad78-657b-4001-8517-9dd07fa38573" path="/var/lib/kubelet/pods/b8bcad78-657b-4001-8517-9dd07fa38573/volumes"
Jul 21 16:34:23.497292 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:23.497261    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-jq8l7"
Jul 21 16:34:23.497702 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:23.497328    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-jq8l7"
Jul 21 16:34:23.519470 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:23.519447    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-jq8l7"
Jul 21 16:34:23.869118 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:23.869097    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-jq8l7"
Jul 21 16:34:28.418564 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.418483    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"]
Jul 21 16:34:28.418908 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.418849    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8bcad78-657b-4001-8517-9dd07fa38573" containerName="registry-server"
Jul 21 16:34:28.418908 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.418862    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8bcad78-657b-4001-8517-9dd07fa38573" containerName="registry-server"
Jul 21 16:34:28.418992 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.418922    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8bcad78-657b-4001-8517-9dd07fa38573" containerName="registry-server"
Jul 21 16:34:28.423480 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.423463    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"
Jul 21 16:34:28.425832 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.425813    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-m5hll\""
Jul 21 16:34:28.430878 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.430859    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"]
Jul 21 16:34:28.485518 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.485491    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb3eb07e-ee39-4630-bb53-47987c19184a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2\" (UID: \"cb3eb07e-ee39-4630-bb53-47987c19184a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"
Jul 21 16:34:28.485608 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.485558    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb3eb07e-ee39-4630-bb53-47987c19184a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2\" (UID: \"cb3eb07e-ee39-4630-bb53-47987c19184a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"
Jul 21 16:34:28.485608 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.485590    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tptfn\" (UniqueName: \"kubernetes.io/projected/cb3eb07e-ee39-4630-bb53-47987c19184a-kube-api-access-tptfn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2\" (UID: \"cb3eb07e-ee39-4630-bb53-47987c19184a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"
Jul 21 16:34:28.586366 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.586333    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb3eb07e-ee39-4630-bb53-47987c19184a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2\" (UID: \"cb3eb07e-ee39-4630-bb53-47987c19184a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"
Jul 21 16:34:28.586466 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.586380    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb3eb07e-ee39-4630-bb53-47987c19184a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2\" (UID: \"cb3eb07e-ee39-4630-bb53-47987c19184a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"
Jul 21 16:34:28.586466 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.586400    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tptfn\" (UniqueName: \"kubernetes.io/projected/cb3eb07e-ee39-4630-bb53-47987c19184a-kube-api-access-tptfn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2\" (UID: \"cb3eb07e-ee39-4630-bb53-47987c19184a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"
Jul 21 16:34:28.587013 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.586986    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb3eb07e-ee39-4630-bb53-47987c19184a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2\" (UID: \"cb3eb07e-ee39-4630-bb53-47987c19184a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"
Jul 21 16:34:28.587174 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.587149    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb3eb07e-ee39-4630-bb53-47987c19184a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2\" (UID: \"cb3eb07e-ee39-4630-bb53-47987c19184a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"
Jul 21 16:34:28.595538 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.595497    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tptfn\" (UniqueName: \"kubernetes.io/projected/cb3eb07e-ee39-4630-bb53-47987c19184a-kube-api-access-tptfn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2\" (UID: \"cb3eb07e-ee39-4630-bb53-47987c19184a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"
Jul 21 16:34:28.732550 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.732478    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"
Jul 21 16:34:28.868178 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:28.868079    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"]
Jul 21 16:34:28.871201 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:34:28.871173    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3eb07e_ee39_4630_bb53_47987c19184a.slice/crio-376c175961d606996336e30b8148f5216441e7009bd22bbc8c56e13043d1a67b WatchSource:0}: Error finding container 376c175961d606996336e30b8148f5216441e7009bd22bbc8c56e13043d1a67b: Status 404 returned error can't find the container with id 376c175961d606996336e30b8148f5216441e7009bd22bbc8c56e13043d1a67b
Jul 21 16:34:29.220572 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.220538    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"]
Jul 21 16:34:29.224072 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.224056    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"
Jul 21 16:34:29.233070 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.233048    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"]
Jul 21 16:34:29.292561 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.292537    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt\" (UID: \"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"
Jul 21 16:34:29.292655 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.292572    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt\" (UID: \"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"
Jul 21 16:34:29.292711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.292648    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7rm8\" (UniqueName: \"kubernetes.io/projected/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-kube-api-access-c7rm8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt\" (UID: \"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"
Jul 21 16:34:29.393821 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.393794    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7rm8\" (UniqueName: \"kubernetes.io/projected/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-kube-api-access-c7rm8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt\" (UID: \"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"
Jul 21 16:34:29.393930 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.393895    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt\" (UID: \"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"
Jul 21 16:34:29.394001 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.393937    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt\" (UID: \"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"
Jul 21 16:34:29.394283 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.394258    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt\" (UID: \"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"
Jul 21 16:34:29.394502 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.394284    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt\" (UID: \"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"
Jul 21 16:34:29.402301 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.402278    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7rm8\" (UniqueName: \"kubernetes.io/projected/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-kube-api-access-c7rm8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt\" (UID: \"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"
Jul 21 16:34:29.533197 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.533170    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"
Jul 21 16:34:29.664213 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.664189    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"]
Jul 21 16:34:29.666028 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:34:29.665997    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b4089f9_1a90_4e87_a1ae_e7fe51f1fb24.slice/crio-406e2497284ed23549fcba9e6362df56ea30a595bd7c727a7fa7469aa8c21fc4 WatchSource:0}: Error finding container 406e2497284ed23549fcba9e6362df56ea30a595bd7c727a7fa7469aa8c21fc4: Status 404 returned error can't find the container with id 406e2497284ed23549fcba9e6362df56ea30a595bd7c727a7fa7469aa8c21fc4
Jul 21 16:34:29.821260 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.821198    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"]
Jul 21 16:34:29.824680 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.824663    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"
Jul 21 16:34:29.833660 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.833638    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"]
Jul 21 16:34:29.879172 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.879136    2524 generic.go:356] "Generic (PLEG): container finished" podID="cb3eb07e-ee39-4630-bb53-47987c19184a" containerID="5e08ec7b4e118bbbdc7301a61d7087fdc2f51659dcf1bd6aea6b9d6c921c4950" exitCode=0
Jul 21 16:34:29.879295 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.879220    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2" event={"ID":"cb3eb07e-ee39-4630-bb53-47987c19184a","Type":"ContainerDied","Data":"5e08ec7b4e118bbbdc7301a61d7087fdc2f51659dcf1bd6aea6b9d6c921c4950"}
Jul 21 16:34:29.879295 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.879273    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2" event={"ID":"cb3eb07e-ee39-4630-bb53-47987c19184a","Type":"ContainerStarted","Data":"376c175961d606996336e30b8148f5216441e7009bd22bbc8c56e13043d1a67b"}
Jul 21 16:34:29.880782 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.880756    2524 generic.go:356] "Generic (PLEG): container finished" podID="4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24" containerID="c22992ab193b4ea68ead2516bfe77e6bd7801967a0cddb28a684f07f0f4f30cc" exitCode=0
Jul 21 16:34:29.880878 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.880836    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt" event={"ID":"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24","Type":"ContainerDied","Data":"c22992ab193b4ea68ead2516bfe77e6bd7801967a0cddb28a684f07f0f4f30cc"}
Jul 21 16:34:29.880878 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.880869    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt" event={"ID":"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24","Type":"ContainerStarted","Data":"406e2497284ed23549fcba9e6362df56ea30a595bd7c727a7fa7469aa8c21fc4"}
Jul 21 16:34:29.898043 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.898018    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9fdq\" (UniqueName: \"kubernetes.io/projected/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-kube-api-access-q9fdq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd\" (UID: \"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"
Jul 21 16:34:29.898162 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.898138    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd\" (UID: \"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"
Jul 21 16:34:29.898318 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.898296    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd\" (UID: \"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"
Jul 21 16:34:29.999637 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.999612    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd\" (UID: \"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"
Jul 21 16:34:29.999722 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.999681    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd\" (UID: \"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"
Jul 21 16:34:29.999758 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.999729    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9fdq\" (UniqueName: \"kubernetes.io/projected/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-kube-api-access-q9fdq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd\" (UID: \"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"
Jul 21 16:34:30.000015 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:29.999995    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd\" (UID: \"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"
Jul 21 16:34:30.000052 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.000000    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd\" (UID: \"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"
Jul 21 16:34:30.009614 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.009587    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9fdq\" (UniqueName: \"kubernetes.io/projected/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-kube-api-access-q9fdq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd\" (UID: \"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"
Jul 21 16:34:30.148114 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.148047    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"
Jul 21 16:34:30.221674 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.221640    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"]
Jul 21 16:34:30.225759 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.225736    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"
Jul 21 16:34:30.234430 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.234365    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"]
Jul 21 16:34:30.294299 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.294276    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"]
Jul 21 16:34:30.301782 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.301754    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj\" (UID: \"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"
Jul 21 16:34:30.301782 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.301782    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj\" (UID: \"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"
Jul 21 16:34:30.301949 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.301805    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbtcs\" (UniqueName: \"kubernetes.io/projected/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-kube-api-access-nbtcs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj\" (UID: \"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"
Jul 21 16:34:30.305809 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:34:30.305786    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d73dbd4_f6c0_4f0b_8978_f137da3a53b1.slice/crio-b91db04b541d8b1663129745dad3941e217a9b209ba103932a396caa54cbae55 WatchSource:0}: Error finding container b91db04b541d8b1663129745dad3941e217a9b209ba103932a396caa54cbae55: Status 404 returned error can't find the container with id b91db04b541d8b1663129745dad3941e217a9b209ba103932a396caa54cbae55
Jul 21 16:34:30.403154 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.403090    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj\" (UID: \"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"
Jul 21 16:34:30.403154 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.403133    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj\" (UID: \"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"
Jul 21 16:34:30.403324 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.403168    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbtcs\" (UniqueName: \"kubernetes.io/projected/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-kube-api-access-nbtcs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj\" (UID: \"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"
Jul 21 16:34:30.403439 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.403420    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj\" (UID: \"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"
Jul 21 16:34:30.403498 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.403449    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj\" (UID: \"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"
Jul 21 16:34:30.417184 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.417157    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbtcs\" (UniqueName: \"kubernetes.io/projected/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-kube-api-access-nbtcs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj\" (UID: \"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"
Jul 21 16:34:30.537959 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.537933    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"
Jul 21 16:34:30.698065 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.698041    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"]
Jul 21 16:34:30.719334 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:34:30.719305    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dcd8c71_4e70_4f1c_993b_04b6895b7d0a.slice/crio-7074bb7c3b022730a5f13f422481be8b25ac478fab5cd0b15473901be0caf06b WatchSource:0}: Error finding container 7074bb7c3b022730a5f13f422481be8b25ac478fab5cd0b15473901be0caf06b: Status 404 returned error can't find the container with id 7074bb7c3b022730a5f13f422481be8b25ac478fab5cd0b15473901be0caf06b
Jul 21 16:34:30.756553 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:34:30.756527    2524 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d73dbd4_f6c0_4f0b_8978_f137da3a53b1.slice/crio-19f475c0b3abbfead6081b590fe0d81cc3fb01c79910d7c01ca752be0017d35f.scope\": RecentStats: unable to find data in memory cache]"
Jul 21 16:34:30.887443 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.887418    2524 generic.go:356] "Generic (PLEG): container finished" podID="2d73dbd4-f6c0-4f0b-8978-f137da3a53b1" containerID="19f475c0b3abbfead6081b590fe0d81cc3fb01c79910d7c01ca752be0017d35f" exitCode=0
Jul 21 16:34:30.887555 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.887500    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd" event={"ID":"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1","Type":"ContainerDied","Data":"19f475c0b3abbfead6081b590fe0d81cc3fb01c79910d7c01ca752be0017d35f"}
Jul 21 16:34:30.887617 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.887585    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd" event={"ID":"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1","Type":"ContainerStarted","Data":"b91db04b541d8b1663129745dad3941e217a9b209ba103932a396caa54cbae55"}
Jul 21 16:34:30.889536 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.889488    2524 generic.go:356] "Generic (PLEG): container finished" podID="cb3eb07e-ee39-4630-bb53-47987c19184a" containerID="c49215fb088f1a5801e38f4628bcde2dab1067f7022c7eaf5bce848d2ec651a5" exitCode=0
Jul 21 16:34:30.889636 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.889567    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2" event={"ID":"cb3eb07e-ee39-4630-bb53-47987c19184a","Type":"ContainerDied","Data":"c49215fb088f1a5801e38f4628bcde2dab1067f7022c7eaf5bce848d2ec651a5"}
Jul 21 16:34:30.891738 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.891717    2524 generic.go:356] "Generic (PLEG): container finished" podID="4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24" containerID="45d77636d04f8ae47257598d17d884a212c3207665f85907a7429223e9403775" exitCode=0
Jul 21 16:34:30.891830 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.891781    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt" event={"ID":"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24","Type":"ContainerDied","Data":"45d77636d04f8ae47257598d17d884a212c3207665f85907a7429223e9403775"}
Jul 21 16:34:30.893435 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.893414    2524 generic.go:356] "Generic (PLEG): container finished" podID="4dcd8c71-4e70-4f1c-993b-04b6895b7d0a" containerID="168a3710acd624a4457aee042b2c9ce196c1ed47fdb35f751fdbcb7e7e6dd904" exitCode=0
Jul 21 16:34:30.893562 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.893440    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj" event={"ID":"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a","Type":"ContainerDied","Data":"168a3710acd624a4457aee042b2c9ce196c1ed47fdb35f751fdbcb7e7e6dd904"}
Jul 21 16:34:30.893562 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:30.893484    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj" event={"ID":"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a","Type":"ContainerStarted","Data":"7074bb7c3b022730a5f13f422481be8b25ac478fab5cd0b15473901be0caf06b"}
Jul 21 16:34:31.899820 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:31.899737    2524 generic.go:356] "Generic (PLEG): container finished" podID="4dcd8c71-4e70-4f1c-993b-04b6895b7d0a" containerID="6e729232505b18fd8a88e0f10d866a3bee64902a4f0d9af24641b657942bb257" exitCode=0
Jul 21 16:34:31.900220 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:31.899820    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj" event={"ID":"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a","Type":"ContainerDied","Data":"6e729232505b18fd8a88e0f10d866a3bee64902a4f0d9af24641b657942bb257"}
Jul 21 16:34:31.902206 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:31.902184    2524 generic.go:356] "Generic (PLEG): container finished" podID="cb3eb07e-ee39-4630-bb53-47987c19184a" containerID="9787b6819731c5299d2e99586bd8f5ee0dc31a07e2b9e1981ca2a87b227e5148" exitCode=0
Jul 21 16:34:31.902304 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:31.902263    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2" event={"ID":"cb3eb07e-ee39-4630-bb53-47987c19184a","Type":"ContainerDied","Data":"9787b6819731c5299d2e99586bd8f5ee0dc31a07e2b9e1981ca2a87b227e5148"}
Jul 21 16:34:31.904410 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:31.904390    2524 generic.go:356] "Generic (PLEG): container finished" podID="4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24" containerID="18eb3831e6b21b1699e6301105f2520c9b7d7ecf394ba8cd24332c74204961a0" exitCode=0
Jul 21 16:34:31.904534 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:31.904450    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt" event={"ID":"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24","Type":"ContainerDied","Data":"18eb3831e6b21b1699e6301105f2520c9b7d7ecf394ba8cd24332c74204961a0"}
Jul 21 16:34:32.912066 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:32.912033    2524 generic.go:356] "Generic (PLEG): container finished" podID="4dcd8c71-4e70-4f1c-993b-04b6895b7d0a" containerID="83a9b94971920f8e8f6ea1dc4bd297729a3b832238a067b5649df8be058473c1" exitCode=0
Jul 21 16:34:32.912489 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:32.912126    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj" event={"ID":"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a","Type":"ContainerDied","Data":"83a9b94971920f8e8f6ea1dc4bd297729a3b832238a067b5649df8be058473c1"}
Jul 21 16:34:33.046334 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.046314    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"
Jul 21 16:34:33.064883 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.064649    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"
Jul 21 16:34:33.128589 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.128558    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-util\") pod \"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24\" (UID: \"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24\") "
Jul 21 16:34:33.128724 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.128615    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tptfn\" (UniqueName: \"kubernetes.io/projected/cb3eb07e-ee39-4630-bb53-47987c19184a-kube-api-access-tptfn\") pod \"cb3eb07e-ee39-4630-bb53-47987c19184a\" (UID: \"cb3eb07e-ee39-4630-bb53-47987c19184a\") "
Jul 21 16:34:33.128724 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.128637    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb3eb07e-ee39-4630-bb53-47987c19184a-bundle\") pod \"cb3eb07e-ee39-4630-bb53-47987c19184a\" (UID: \"cb3eb07e-ee39-4630-bb53-47987c19184a\") "
Jul 21 16:34:33.128724 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.128654    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7rm8\" (UniqueName: \"kubernetes.io/projected/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-kube-api-access-c7rm8\") pod \"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24\" (UID: \"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24\") "
Jul 21 16:34:33.128724 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.128683    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-bundle\") pod \"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24\" (UID: \"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24\") "
Jul 21 16:34:33.128946 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.128760    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb3eb07e-ee39-4630-bb53-47987c19184a-util\") pod \"cb3eb07e-ee39-4630-bb53-47987c19184a\" (UID: \"cb3eb07e-ee39-4630-bb53-47987c19184a\") "
Jul 21 16:34:33.129210 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.129185    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-bundle" (OuterVolumeSpecName: "bundle") pod "4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24" (UID: "4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:33.129349 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.129292    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb3eb07e-ee39-4630-bb53-47987c19184a-bundle" (OuterVolumeSpecName: "bundle") pod "cb3eb07e-ee39-4630-bb53-47987c19184a" (UID: "cb3eb07e-ee39-4630-bb53-47987c19184a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:33.130926 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.130903    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb3eb07e-ee39-4630-bb53-47987c19184a-kube-api-access-tptfn" (OuterVolumeSpecName: "kube-api-access-tptfn") pod "cb3eb07e-ee39-4630-bb53-47987c19184a" (UID: "cb3eb07e-ee39-4630-bb53-47987c19184a"). InnerVolumeSpecName "kube-api-access-tptfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:34:33.131079 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.131062    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-kube-api-access-c7rm8" (OuterVolumeSpecName: "kube-api-access-c7rm8") pod "4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24" (UID: "4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24"). InnerVolumeSpecName "kube-api-access-c7rm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:34:33.134935 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.134912    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-util" (OuterVolumeSpecName: "util") pod "4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24" (UID: "4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:33.135844 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.135823    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb3eb07e-ee39-4630-bb53-47987c19184a-util" (OuterVolumeSpecName: "util") pod "cb3eb07e-ee39-4630-bb53-47987c19184a" (UID: "cb3eb07e-ee39-4630-bb53-47987c19184a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:33.229805 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.229716    2524 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb3eb07e-ee39-4630-bb53-47987c19184a-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:34:33.229805 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.229745    2524 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:34:33.229805 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.229754    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tptfn\" (UniqueName: \"kubernetes.io/projected/cb3eb07e-ee39-4630-bb53-47987c19184a-kube-api-access-tptfn\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:34:33.229805 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.229764    2524 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb3eb07e-ee39-4630-bb53-47987c19184a-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:34:33.229805 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.229773    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7rm8\" (UniqueName: \"kubernetes.io/projected/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-kube-api-access-c7rm8\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:34:33.229805 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.229781    2524 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:34:33.919871 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.919847    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2"
Jul 21 16:34:33.920316 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.919843    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2" event={"ID":"cb3eb07e-ee39-4630-bb53-47987c19184a","Type":"ContainerDied","Data":"376c175961d606996336e30b8148f5216441e7009bd22bbc8c56e13043d1a67b"}
Jul 21 16:34:33.920316 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.919975    2524 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="376c175961d606996336e30b8148f5216441e7009bd22bbc8c56e13043d1a67b"
Jul 21 16:34:33.921804 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.921786    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt"
Jul 21 16:34:33.921915 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.921813    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt" event={"ID":"4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24","Type":"ContainerDied","Data":"406e2497284ed23549fcba9e6362df56ea30a595bd7c727a7fa7469aa8c21fc4"}
Jul 21 16:34:33.921915 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:33.921844    2524 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="406e2497284ed23549fcba9e6362df56ea30a595bd7c727a7fa7469aa8c21fc4"
Jul 21 16:34:34.063148 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:34.063118    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"
Jul 21 16:34:34.137735 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:34.137702    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbtcs\" (UniqueName: \"kubernetes.io/projected/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-kube-api-access-nbtcs\") pod \"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a\" (UID: \"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a\") "
Jul 21 16:34:34.137898 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:34.137792    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-bundle\") pod \"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a\" (UID: \"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a\") "
Jul 21 16:34:34.137898 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:34.137817    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-util\") pod \"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a\" (UID: \"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a\") "
Jul 21 16:34:34.138499 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:34.138471    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-bundle" (OuterVolumeSpecName: "bundle") pod "4dcd8c71-4e70-4f1c-993b-04b6895b7d0a" (UID: "4dcd8c71-4e70-4f1c-993b-04b6895b7d0a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:34.139930 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:34.139906    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-kube-api-access-nbtcs" (OuterVolumeSpecName: "kube-api-access-nbtcs") pod "4dcd8c71-4e70-4f1c-993b-04b6895b7d0a" (UID: "4dcd8c71-4e70-4f1c-993b-04b6895b7d0a"). InnerVolumeSpecName "kube-api-access-nbtcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:34:34.145544 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:34.145496    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-util" (OuterVolumeSpecName: "util") pod "4dcd8c71-4e70-4f1c-993b-04b6895b7d0a" (UID: "4dcd8c71-4e70-4f1c-993b-04b6895b7d0a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:34.238906 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:34.238825    2524 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:34:34.238906 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:34.238858    2524 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:34:34.238906 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:34.238872    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbtcs\" (UniqueName: \"kubernetes.io/projected/4dcd8c71-4e70-4f1c-993b-04b6895b7d0a-kube-api-access-nbtcs\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:34:34.928389 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:34.928359    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj"
Jul 21 16:34:34.928920 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:34.928385    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj" event={"ID":"4dcd8c71-4e70-4f1c-993b-04b6895b7d0a","Type":"ContainerDied","Data":"7074bb7c3b022730a5f13f422481be8b25ac478fab5cd0b15473901be0caf06b"}
Jul 21 16:34:34.928920 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:34.928433    2524 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7074bb7c3b022730a5f13f422481be8b25ac478fab5cd0b15473901be0caf06b"
Jul 21 16:34:34.930226 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:34.930206    2524 generic.go:356] "Generic (PLEG): container finished" podID="2d73dbd4-f6c0-4f0b-8978-f137da3a53b1" containerID="491402e4cac3005f16952a648c8107b90fc99ec7259ef44bef2b0cff46e8a575" exitCode=0
Jul 21 16:34:34.930339 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:34.930303    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd" event={"ID":"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1","Type":"ContainerDied","Data":"491402e4cac3005f16952a648c8107b90fc99ec7259ef44bef2b0cff46e8a575"}
Jul 21 16:34:35.937456 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:35.937425    2524 generic.go:356] "Generic (PLEG): container finished" podID="2d73dbd4-f6c0-4f0b-8978-f137da3a53b1" containerID="d83fc405b490573d67ac45adedbd8f412653e0c08c3ec496c979849c1536b374" exitCode=0
Jul 21 16:34:35.937856 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:35.937523    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd" event={"ID":"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1","Type":"ContainerDied","Data":"d83fc405b490573d67ac45adedbd8f412653e0c08c3ec496c979849c1536b374"}
Jul 21 16:34:37.080908 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:37.080881    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"
Jul 21 16:34:37.165367 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:37.165336    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-bundle\") pod \"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1\" (UID: \"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1\") "
Jul 21 16:34:37.165536 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:37.165415    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9fdq\" (UniqueName: \"kubernetes.io/projected/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-kube-api-access-q9fdq\") pod \"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1\" (UID: \"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1\") "
Jul 21 16:34:37.165536 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:37.165448    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-util\") pod \"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1\" (UID: \"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1\") "
Jul 21 16:34:37.165926 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:37.165903    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-bundle" (OuterVolumeSpecName: "bundle") pod "2d73dbd4-f6c0-4f0b-8978-f137da3a53b1" (UID: "2d73dbd4-f6c0-4f0b-8978-f137da3a53b1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:37.167623 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:37.167597    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-kube-api-access-q9fdq" (OuterVolumeSpecName: "kube-api-access-q9fdq") pod "2d73dbd4-f6c0-4f0b-8978-f137da3a53b1" (UID: "2d73dbd4-f6c0-4f0b-8978-f137da3a53b1"). InnerVolumeSpecName "kube-api-access-q9fdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:34:37.169986 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:37.169960    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-util" (OuterVolumeSpecName: "util") pod "2d73dbd4-f6c0-4f0b-8978-f137da3a53b1" (UID: "2d73dbd4-f6c0-4f0b-8978-f137da3a53b1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:34:37.266847 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:37.266820    2524 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-bundle\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:34:37.266847 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:37.266845    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9fdq\" (UniqueName: \"kubernetes.io/projected/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-kube-api-access-q9fdq\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:34:37.266999 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:37.266855    2524 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d73dbd4-f6c0-4f0b-8978-f137da3a53b1-util\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:34:37.949640 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:37.949605    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd" event={"ID":"2d73dbd4-f6c0-4f0b-8978-f137da3a53b1","Type":"ContainerDied","Data":"b91db04b541d8b1663129745dad3941e217a9b209ba103932a396caa54cbae55"}
Jul 21 16:34:37.949802 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:37.949648    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd"
Jul 21 16:34:37.949802 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:37.949679    2524 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b91db04b541d8b1663129745dad3941e217a9b209ba103932a396caa54cbae55"
Jul 21 16:34:42.564560 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564526    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75f594d4d6-bflqk"]
Jul 21 16:34:42.564965 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564888    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24" containerName="util"
Jul 21 16:34:42.564965 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564902    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24" containerName="util"
Jul 21 16:34:42.564965 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564912    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d73dbd4-f6c0-4f0b-8978-f137da3a53b1" containerName="pull"
Jul 21 16:34:42.564965 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564917    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d73dbd4-f6c0-4f0b-8978-f137da3a53b1" containerName="pull"
Jul 21 16:34:42.564965 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564923    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d73dbd4-f6c0-4f0b-8978-f137da3a53b1" containerName="extract"
Jul 21 16:34:42.564965 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564928    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d73dbd4-f6c0-4f0b-8978-f137da3a53b1" containerName="extract"
Jul 21 16:34:42.564965 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564937    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24" containerName="pull"
Jul 21 16:34:42.564965 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564942    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24" containerName="pull"
Jul 21 16:34:42.564965 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564951    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb3eb07e-ee39-4630-bb53-47987c19184a" containerName="pull"
Jul 21 16:34:42.564965 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564959    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb3eb07e-ee39-4630-bb53-47987c19184a" containerName="pull"
Jul 21 16:34:42.564965 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564972    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb3eb07e-ee39-4630-bb53-47987c19184a" containerName="extract"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564977    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb3eb07e-ee39-4630-bb53-47987c19184a" containerName="extract"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564984    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dcd8c71-4e70-4f1c-993b-04b6895b7d0a" containerName="pull"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564988    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dcd8c71-4e70-4f1c-993b-04b6895b7d0a" containerName="pull"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.564996    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d73dbd4-f6c0-4f0b-8978-f137da3a53b1" containerName="util"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.565001    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d73dbd4-f6c0-4f0b-8978-f137da3a53b1" containerName="util"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.565009    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dcd8c71-4e70-4f1c-993b-04b6895b7d0a" containerName="extract"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.565014    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dcd8c71-4e70-4f1c-993b-04b6895b7d0a" containerName="extract"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.565021    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24" containerName="extract"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.565027    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24" containerName="extract"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.565037    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb3eb07e-ee39-4630-bb53-47987c19184a" containerName="util"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.565044    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb3eb07e-ee39-4630-bb53-47987c19184a" containerName="util"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.565052    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dcd8c71-4e70-4f1c-993b-04b6895b7d0a" containerName="util"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.565059    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dcd8c71-4e70-4f1c-993b-04b6895b7d0a" containerName="util"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.565136    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24" containerName="extract"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.565149    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d73dbd4-f6c0-4f0b-8978-f137da3a53b1" containerName="extract"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.565159    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb3eb07e-ee39-4630-bb53-47987c19184a" containerName="extract"
Jul 21 16:34:42.565442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.565165    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dcd8c71-4e70-4f1c-993b-04b6895b7d0a" containerName="extract"
Jul 21 16:34:42.568482 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.568460    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.571106 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.571082    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 16:34:42.571398 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.571379    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 16:34:42.572126 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.572102    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 16:34:42.572243 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.572154    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 16:34:42.572326 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.572273    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bhspf\""
Jul 21 16:34:42.572391 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.572344    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 16:34:42.572450 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.572429    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 16:34:42.572590 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.572573    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 16:34:42.577763 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.577742    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 21 16:34:42.583756 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.583735    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75f594d4d6-bflqk"]
Jul 21 16:34:42.620641 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.620615    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9af1a73-4824-4423-ac6e-24864fc78bbb-oauth-serving-cert\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.620785 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.620672    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9af1a73-4824-4423-ac6e-24864fc78bbb-console-serving-cert\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.620785 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.620694    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9af1a73-4824-4423-ac6e-24864fc78bbb-console-config\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.620785 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.620747    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9af1a73-4824-4423-ac6e-24864fc78bbb-service-ca\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.620785 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.620782    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9af1a73-4824-4423-ac6e-24864fc78bbb-console-oauth-config\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.621012 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.620810    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zznh\" (UniqueName: \"kubernetes.io/projected/d9af1a73-4824-4423-ac6e-24864fc78bbb-kube-api-access-8zznh\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.621012 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.620846    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9af1a73-4824-4423-ac6e-24864fc78bbb-trusted-ca-bundle\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.721422 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.721388    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9af1a73-4824-4423-ac6e-24864fc78bbb-console-oauth-config\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.721422 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.721427    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zznh\" (UniqueName: \"kubernetes.io/projected/d9af1a73-4824-4423-ac6e-24864fc78bbb-kube-api-access-8zznh\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.721710 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.721444    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9af1a73-4824-4423-ac6e-24864fc78bbb-trusted-ca-bundle\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.721710 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.721483    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9af1a73-4824-4423-ac6e-24864fc78bbb-oauth-serving-cert\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.721710 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.721584    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9af1a73-4824-4423-ac6e-24864fc78bbb-console-serving-cert\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.721710 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.721620    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9af1a73-4824-4423-ac6e-24864fc78bbb-console-config\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.721710 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.721645    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9af1a73-4824-4423-ac6e-24864fc78bbb-service-ca\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.722376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.722346    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9af1a73-4824-4423-ac6e-24864fc78bbb-console-config\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.722376 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.722364    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9af1a73-4824-4423-ac6e-24864fc78bbb-trusted-ca-bundle\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.722588 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.722406    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9af1a73-4824-4423-ac6e-24864fc78bbb-service-ca\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.722751 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.722729    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9af1a73-4824-4423-ac6e-24864fc78bbb-oauth-serving-cert\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.724037 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.724016    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9af1a73-4824-4423-ac6e-24864fc78bbb-console-oauth-config\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.724134 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.724121    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9af1a73-4824-4423-ac6e-24864fc78bbb-console-serving-cert\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.730314 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.730293    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zznh\" (UniqueName: \"kubernetes.io/projected/d9af1a73-4824-4423-ac6e-24864fc78bbb-kube-api-access-8zznh\") pod \"console-75f594d4d6-bflqk\" (UID: \"d9af1a73-4824-4423-ac6e-24864fc78bbb\") " pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:42.880464 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:42.880389    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:43.068720 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:43.068693    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75f594d4d6-bflqk"]
Jul 21 16:34:43.070886 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:34:43.070856    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9af1a73_4824_4423_ac6e_24864fc78bbb.slice/crio-142c74fbaea78346d9503364c56fffa4f138a15127c08f21c7050f2e7d815bcf WatchSource:0}: Error finding container 142c74fbaea78346d9503364c56fffa4f138a15127c08f21c7050f2e7d815bcf: Status 404 returned error can't find the container with id 142c74fbaea78346d9503364c56fffa4f138a15127c08f21c7050f2e7d815bcf
Jul 21 16:34:43.983700 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:43.983653    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f594d4d6-bflqk" event={"ID":"d9af1a73-4824-4423-ac6e-24864fc78bbb","Type":"ContainerStarted","Data":"142c74fbaea78346d9503364c56fffa4f138a15127c08f21c7050f2e7d815bcf"}
Jul 21 16:34:45.756596 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:45.756559    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wzn4w"]
Jul 21 16:34:45.766692 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:45.766664    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzn4w"
Jul 21 16:34:45.769185 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:45.769162    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6t7mx\""
Jul 21 16:34:45.782288 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:45.782264    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wzn4w"]
Jul 21 16:34:45.852588 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:45.852560    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw8h9\" (UniqueName: \"kubernetes.io/projected/c9e6f83b-ad70-4d3f-92da-5696b4d8b2ca-kube-api-access-dw8h9\") pod \"authorino-operator-75cc8d5cb7-wzn4w\" (UID: \"c9e6f83b-ad70-4d3f-92da-5696b4d8b2ca\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzn4w"
Jul 21 16:34:45.953707 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:45.953675    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw8h9\" (UniqueName: \"kubernetes.io/projected/c9e6f83b-ad70-4d3f-92da-5696b4d8b2ca-kube-api-access-dw8h9\") pod \"authorino-operator-75cc8d5cb7-wzn4w\" (UID: \"c9e6f83b-ad70-4d3f-92da-5696b4d8b2ca\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzn4w"
Jul 21 16:34:45.968257 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:45.968216    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw8h9\" (UniqueName: \"kubernetes.io/projected/c9e6f83b-ad70-4d3f-92da-5696b4d8b2ca-kube-api-access-dw8h9\") pod \"authorino-operator-75cc8d5cb7-wzn4w\" (UID: \"c9e6f83b-ad70-4d3f-92da-5696b4d8b2ca\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzn4w"
Jul 21 16:34:45.997551 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:45.997495    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f594d4d6-bflqk" event={"ID":"d9af1a73-4824-4423-ac6e-24864fc78bbb","Type":"ContainerStarted","Data":"fa4acccf48fd5b4a9008cb266ad03b8888aba68a711969b9e2e0126f8f1d7860"}
Jul 21 16:34:46.018798 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:46.018752    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75f594d4d6-bflqk" podStartSLOduration=1.248059456 podStartE2EDuration="4.018737697s" totalImagesPullingTime="2.770678241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:46.016987588 +0000 UTC m=+386.413218403" watchObservedRunningTime="2026-07-21 16:34:46.018737697 +0000 UTC m=+386.414968477"
Jul 21 16:34:46.077607 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:46.077581    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzn4w"
Jul 21 16:34:46.215900 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:46.215877    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wzn4w"]
Jul 21 16:34:46.217441 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:34:46.217415    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9e6f83b_ad70_4d3f_92da_5696b4d8b2ca.slice/crio-a4cbb9d85de055789afdf77c487901914b602beac90850c81cc6385b82ac9199 WatchSource:0}: Error finding container a4cbb9d85de055789afdf77c487901914b602beac90850c81cc6385b82ac9199: Status 404 returned error can't find the container with id a4cbb9d85de055789afdf77c487901914b602beac90850c81cc6385b82ac9199
Jul 21 16:34:47.008959 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:47.008914    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzn4w" event={"ID":"c9e6f83b-ad70-4d3f-92da-5696b4d8b2ca","Type":"ContainerStarted","Data":"a4cbb9d85de055789afdf77c487901914b602beac90850c81cc6385b82ac9199"}
Jul 21 16:34:49.024258 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:49.024221    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzn4w" event={"ID":"c9e6f83b-ad70-4d3f-92da-5696b4d8b2ca","Type":"ContainerStarted","Data":"dd72b60b24687c131f1c3db2cfa7a24e5e1171b5ce89dc9e5cadde6de5a31b34"}
Jul 21 16:34:49.024642 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:49.024370    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzn4w"
Jul 21 16:34:49.043492 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:49.043444    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzn4w" podStartSLOduration=1.810298491 podStartE2EDuration="4.043430468s" totalImagesPullingTime="2.233131977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:49.04249836 +0000 UTC m=+389.438729141" watchObservedRunningTime="2026-07-21 16:34:49.043430468 +0000 UTC m=+389.439661248"
Jul 21 16:34:49.679897 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:49.679864    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"]
Jul 21 16:34:49.683320 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:49.683299    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:34:49.686086 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:49.686071    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dcmnb\""
Jul 21 16:34:49.697960 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:49.697933    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"]
Jul 21 16:34:49.789848 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:49.789819    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dcf160e-0f33-4b8e-b43d-98c284484412-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vb9d6\" (UID: \"4dcf160e-0f33-4b8e-b43d-98c284484412\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:34:49.789964 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:49.789853    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcxwn\" (UniqueName: \"kubernetes.io/projected/4dcf160e-0f33-4b8e-b43d-98c284484412-kube-api-access-mcxwn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vb9d6\" (UID: \"4dcf160e-0f33-4b8e-b43d-98c284484412\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:34:49.890471 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:49.890441    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dcf160e-0f33-4b8e-b43d-98c284484412-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vb9d6\" (UID: \"4dcf160e-0f33-4b8e-b43d-98c284484412\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:34:49.890586 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:49.890473    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcxwn\" (UniqueName: \"kubernetes.io/projected/4dcf160e-0f33-4b8e-b43d-98c284484412-kube-api-access-mcxwn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vb9d6\" (UID: \"4dcf160e-0f33-4b8e-b43d-98c284484412\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:34:49.890889 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:49.890870    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dcf160e-0f33-4b8e-b43d-98c284484412-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vb9d6\" (UID: \"4dcf160e-0f33-4b8e-b43d-98c284484412\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:34:49.901950 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:49.901924    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcxwn\" (UniqueName: \"kubernetes.io/projected/4dcf160e-0f33-4b8e-b43d-98c284484412-kube-api-access-mcxwn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vb9d6\" (UID: \"4dcf160e-0f33-4b8e-b43d-98c284484412\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:34:49.993191 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:49.993130    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:34:50.139947 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:50.139917    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"]
Jul 21 16:34:50.143686 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:34:50.143657    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dcf160e_0f33_4b8e_b43d_98c284484412.slice/crio-0607b7066eb02dd115c8a5037ff88b6ad4aa854fe34c79c98744ecfeb93aa5ca WatchSource:0}: Error finding container 0607b7066eb02dd115c8a5037ff88b6ad4aa854fe34c79c98744ecfeb93aa5ca: Status 404 returned error can't find the container with id 0607b7066eb02dd115c8a5037ff88b6ad4aa854fe34c79c98744ecfeb93aa5ca
Jul 21 16:34:51.039276 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:51.039236    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6" event={"ID":"4dcf160e-0f33-4b8e-b43d-98c284484412","Type":"ContainerStarted","Data":"0607b7066eb02dd115c8a5037ff88b6ad4aa854fe34c79c98744ecfeb93aa5ca"}
Jul 21 16:34:52.881361 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:52.881326    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:52.881814 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:52.881387    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:52.886283 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:52.886263    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:53.053605 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:53.053579    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75f594d4d6-bflqk"
Jul 21 16:34:54.179097 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:54.179062    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6k5n"]
Jul 21 16:34:54.183201 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:54.183179    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6k5n"
Jul 21 16:34:54.187140 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:54.187115    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qwxxs\""
Jul 21 16:34:54.187797 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:54.187779    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 21 16:34:54.204837 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:54.204810    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6k5n"]
Jul 21 16:34:54.332499 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:54.332454    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdtr2\" (UniqueName: \"kubernetes.io/projected/e79750b5-f399-4e50-a69a-6f179a0995ac-kube-api-access-jdtr2\") pod \"dns-operator-controller-manager-864dd78c4c-k6k5n\" (UID: \"e79750b5-f399-4e50-a69a-6f179a0995ac\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6k5n"
Jul 21 16:34:54.433772 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:54.433651    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdtr2\" (UniqueName: \"kubernetes.io/projected/e79750b5-f399-4e50-a69a-6f179a0995ac-kube-api-access-jdtr2\") pod \"dns-operator-controller-manager-864dd78c4c-k6k5n\" (UID: \"e79750b5-f399-4e50-a69a-6f179a0995ac\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6k5n"
Jul 21 16:34:54.444727 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:54.444696    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdtr2\" (UniqueName: \"kubernetes.io/projected/e79750b5-f399-4e50-a69a-6f179a0995ac-kube-api-access-jdtr2\") pod \"dns-operator-controller-manager-864dd78c4c-k6k5n\" (UID: \"e79750b5-f399-4e50-a69a-6f179a0995ac\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6k5n"
Jul 21 16:34:54.502863 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:54.502653    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6k5n"
Jul 21 16:34:55.486764 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:55.486740    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6k5n"]
Jul 21 16:34:55.490135 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:34:55.490110    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79750b5_f399_4e50_a69a_6f179a0995ac.slice/crio-8dd6e292cf57cf23be3ea75e78cd50adbcaa4543253a9332d6627b71ca156a0a WatchSource:0}: Error finding container 8dd6e292cf57cf23be3ea75e78cd50adbcaa4543253a9332d6627b71ca156a0a: Status 404 returned error can't find the container with id 8dd6e292cf57cf23be3ea75e78cd50adbcaa4543253a9332d6627b71ca156a0a
Jul 21 16:34:56.068280 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:56.068235    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6k5n" event={"ID":"e79750b5-f399-4e50-a69a-6f179a0995ac","Type":"ContainerStarted","Data":"8dd6e292cf57cf23be3ea75e78cd50adbcaa4543253a9332d6627b71ca156a0a"}
Jul 21 16:34:56.071114 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:56.071078    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6" event={"ID":"4dcf160e-0f33-4b8e-b43d-98c284484412","Type":"ContainerStarted","Data":"0b71938f044d19837461c08e6e4c52eb692e1f843e2dbc751ebcc872d4f601fe"}
Jul 21 16:34:56.071254 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:56.071229    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:34:56.098045 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:56.097994    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6" podStartSLOduration=1.8380464380000001 podStartE2EDuration="7.097971772s" totalImagesPullingTime="5.259925334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:56.094677469 +0000 UTC m=+396.490908250" watchObservedRunningTime="2026-07-21 16:34:56.097971772 +0000 UTC m=+396.494202553"
Jul 21 16:34:58.083755 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.083723    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6k5n" event={"ID":"e79750b5-f399-4e50-a69a-6f179a0995ac","Type":"ContainerStarted","Data":"33ab097e76ad949a8936f6cfadc2678edeb821f5b3a77a6b26d46727f1cf503c"}
Jul 21 16:34:58.084196 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.083867    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6k5n"
Jul 21 16:34:58.103612 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.103568    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6k5n" podStartSLOduration=2.528270927 podStartE2EDuration="4.103555323s" totalImagesPullingTime="1.575284396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:58.101092598 +0000 UTC m=+398.497323418" watchObservedRunningTime="2026-07-21 16:34:58.103555323 +0000 UTC m=+398.499786103"
Jul 21 16:34:58.281803 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.281772    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll"]
Jul 21 16:34:58.286839 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.286811    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll"
Jul 21 16:34:58.290041 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.290018    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 21 16:34:58.290174 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.290070    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-m5hll\""
Jul 21 16:34:58.290174 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.290070    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 21 16:34:58.294530 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.294481    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll"]
Jul 21 16:34:58.472428 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.472338    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hpnq\" (UniqueName: \"kubernetes.io/projected/7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5-kube-api-access-8hpnq\") pod \"kuadrant-console-plugin-66b5774985-vk5ll\" (UID: \"7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll"
Jul 21 16:34:58.472428 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.472410    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vk5ll\" (UID: \"7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll"
Jul 21 16:34:58.472671 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.472501    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vk5ll\" (UID: \"7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll"
Jul 21 16:34:58.573245 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.573210    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vk5ll\" (UID: \"7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll"
Jul 21 16:34:58.573366 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.573267    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hpnq\" (UniqueName: \"kubernetes.io/projected/7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5-kube-api-access-8hpnq\") pod \"kuadrant-console-plugin-66b5774985-vk5ll\" (UID: \"7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll"
Jul 21 16:34:58.573366 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.573306    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vk5ll\" (UID: \"7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll"
Jul 21 16:34:58.573931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.573914    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vk5ll\" (UID: \"7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll"
Jul 21 16:34:58.575707 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.575687    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vk5ll\" (UID: \"7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll"
Jul 21 16:34:58.582682 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.582646    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hpnq\" (UniqueName: \"kubernetes.io/projected/7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5-kube-api-access-8hpnq\") pod \"kuadrant-console-plugin-66b5774985-vk5ll\" (UID: \"7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll"
Jul 21 16:34:58.598426 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.598407    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll"
Jul 21 16:34:58.737326 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:58.737296    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll"]
Jul 21 16:34:58.738287 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:34:58.738261    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e6c64af_ae0f_4b03_8b3a_1ff8fa7560c5.slice/crio-e043e98d9c0743fb1adae6c6f4bc4d4b6fb817fc79cd9191b1f729ba4d12a8e6 WatchSource:0}: Error finding container e043e98d9c0743fb1adae6c6f4bc4d4b6fb817fc79cd9191b1f729ba4d12a8e6: Status 404 returned error can't find the container with id e043e98d9c0743fb1adae6c6f4bc4d4b6fb817fc79cd9191b1f729ba4d12a8e6
Jul 21 16:34:59.090403 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:34:59.090368    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll" event={"ID":"7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5","Type":"ContainerStarted","Data":"e043e98d9c0743fb1adae6c6f4bc4d4b6fb817fc79cd9191b1f729ba4d12a8e6"}
Jul 21 16:35:00.033530 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:00.033345    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wzn4w"
Jul 21 16:35:07.080147 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:07.080113    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:35:08.772460 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:08.772414    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"]
Jul 21 16:35:08.772978 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:08.772664    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6" podUID="4dcf160e-0f33-4b8e-b43d-98c284484412" containerName="manager" containerID="cri-o://0b71938f044d19837461c08e6e4c52eb692e1f843e2dbc751ebcc872d4f601fe" gracePeriod=2
Jul 21 16:35:08.774923 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:35:08.774891    2524 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vb9d6\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" podUID="4dcf160e-0f33-4b8e-b43d-98c284484412" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:35:08.775716 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:08.775692    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"]
Jul 21 16:35:08.812654 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:08.812603    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"]
Jul 21 16:35:08.813463 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:08.813438    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dcf160e-0f33-4b8e-b43d-98c284484412" containerName="manager"
Jul 21 16:35:08.813632 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:08.813617    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dcf160e-0f33-4b8e-b43d-98c284484412" containerName="manager"
Jul 21 16:35:08.813873 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:08.813855    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dcf160e-0f33-4b8e-b43d-98c284484412" containerName="manager"
Jul 21 16:35:08.835409 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:08.835386    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"
Jul 21 16:35:08.836549 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:08.836527    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"]
Jul 21 16:35:08.873073 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:08.873041    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv6mg\" (UniqueName: \"kubernetes.io/projected/dd366d49-58c4-4396-a669-aea0f05a7252-kube-api-access-mv6mg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nzl7z\" (UID: \"dd366d49-58c4-4396-a669-aea0f05a7252\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"
Jul 21 16:35:08.873263 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:08.873188    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd366d49-58c4-4396-a669-aea0f05a7252-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nzl7z\" (UID: \"dd366d49-58c4-4396-a669-aea0f05a7252\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"
Jul 21 16:35:08.885712 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:35:08.885679    2524 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vb9d6\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" podUID="4dcf160e-0f33-4b8e-b43d-98c284484412" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:35:08.974771 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:08.974721    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd366d49-58c4-4396-a669-aea0f05a7252-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nzl7z\" (UID: \"dd366d49-58c4-4396-a669-aea0f05a7252\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"
Jul 21 16:35:08.974969 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:08.974787    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv6mg\" (UniqueName: \"kubernetes.io/projected/dd366d49-58c4-4396-a669-aea0f05a7252-kube-api-access-mv6mg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nzl7z\" (UID: \"dd366d49-58c4-4396-a669-aea0f05a7252\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"
Jul 21 16:35:08.975198 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:08.975139    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd366d49-58c4-4396-a669-aea0f05a7252-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nzl7z\" (UID: \"dd366d49-58c4-4396-a669-aea0f05a7252\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"
Jul 21 16:35:08.995276 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:08.995239    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv6mg\" (UniqueName: \"kubernetes.io/projected/dd366d49-58c4-4396-a669-aea0f05a7252-kube-api-access-mv6mg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nzl7z\" (UID: \"dd366d49-58c4-4396-a669-aea0f05a7252\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"
Jul 21 16:35:09.079422 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:09.079280    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"]
Jul 21 16:35:09.093845 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:09.093812    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-k6k5n"
Jul 21 16:35:09.094032 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:09.094010    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"
Jul 21 16:35:09.095966 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:35:09.095934    2524 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vb9d6\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" podUID="4dcf160e-0f33-4b8e-b43d-98c284484412" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:35:09.104078 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:09.104056    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"]
Jul 21 16:35:09.126948 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:35:09.126915    2524 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vb9d6\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" podUID="4dcf160e-0f33-4b8e-b43d-98c284484412" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:35:09.177536 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:09.177476    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6aac9d0-5e77-4c04-90c7-539e8279ac7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xlm5l\" (UID: \"c6aac9d0-5e77-4c04-90c7-539e8279ac7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"
Jul 21 16:35:09.177707 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:09.177614    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh9cs\" (UniqueName: \"kubernetes.io/projected/c6aac9d0-5e77-4c04-90c7-539e8279ac7c-kube-api-access-sh9cs\") pod \"kuadrant-operator-controller-manager-86878c769f-xlm5l\" (UID: \"c6aac9d0-5e77-4c04-90c7-539e8279ac7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"
Jul 21 16:35:09.203334 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:09.203301    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"
Jul 21 16:35:09.278242 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:09.278196    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh9cs\" (UniqueName: \"kubernetes.io/projected/c6aac9d0-5e77-4c04-90c7-539e8279ac7c-kube-api-access-sh9cs\") pod \"kuadrant-operator-controller-manager-86878c769f-xlm5l\" (UID: \"c6aac9d0-5e77-4c04-90c7-539e8279ac7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"
Jul 21 16:35:09.278426 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:09.278350    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6aac9d0-5e77-4c04-90c7-539e8279ac7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xlm5l\" (UID: \"c6aac9d0-5e77-4c04-90c7-539e8279ac7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"
Jul 21 16:35:09.278737 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:09.278711    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6aac9d0-5e77-4c04-90c7-539e8279ac7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xlm5l\" (UID: \"c6aac9d0-5e77-4c04-90c7-539e8279ac7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"
Jul 21 16:35:09.290785 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:09.290759    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh9cs\" (UniqueName: \"kubernetes.io/projected/c6aac9d0-5e77-4c04-90c7-539e8279ac7c-kube-api-access-sh9cs\") pod \"kuadrant-operator-controller-manager-86878c769f-xlm5l\" (UID: \"c6aac9d0-5e77-4c04-90c7-539e8279ac7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"
Jul 21 16:35:09.409876 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:09.409776    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"
Jul 21 16:35:10.060340 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:35:10.060294    2524 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vb9d6\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" podUID="4dcf160e-0f33-4b8e-b43d-98c284484412" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:35:19.707695 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:19.707659    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:35:19.716437 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:19.716349    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"]
Jul 21 16:35:19.719085 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:35:19.719051    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd366d49_58c4_4396_a669_aea0f05a7252.slice/crio-0191acff08d45989a8bff78c43ee475f622a00f9b92f1790f2c478b512528df6 WatchSource:0}: Error finding container 0191acff08d45989a8bff78c43ee475f622a00f9b92f1790f2c478b512528df6: Status 404 returned error can't find the container with id 0191acff08d45989a8bff78c43ee475f622a00f9b92f1790f2c478b512528df6
Jul 21 16:35:19.742451 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:19.742420    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"]
Jul 21 16:35:19.745307 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:35:19.745281    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6aac9d0_5e77_4c04_90c7_539e8279ac7c.slice/crio-331bdb1e680b596792cb82231fba804ec0da0377c456a395bc696c5fa6cc5494 WatchSource:0}: Error finding container 331bdb1e680b596792cb82231fba804ec0da0377c456a395bc696c5fa6cc5494: Status 404 returned error can't find the container with id 331bdb1e680b596792cb82231fba804ec0da0377c456a395bc696c5fa6cc5494
Jul 21 16:35:19.784122 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:19.784095    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcxwn\" (UniqueName: \"kubernetes.io/projected/4dcf160e-0f33-4b8e-b43d-98c284484412-kube-api-access-mcxwn\") pod \"4dcf160e-0f33-4b8e-b43d-98c284484412\" (UID: \"4dcf160e-0f33-4b8e-b43d-98c284484412\") "
Jul 21 16:35:19.784220 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:19.784182    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dcf160e-0f33-4b8e-b43d-98c284484412-extensions-socket-volume\") pod \"4dcf160e-0f33-4b8e-b43d-98c284484412\" (UID: \"4dcf160e-0f33-4b8e-b43d-98c284484412\") "
Jul 21 16:35:19.784779 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:19.784752    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dcf160e-0f33-4b8e-b43d-98c284484412-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4dcf160e-0f33-4b8e-b43d-98c284484412" (UID: "4dcf160e-0f33-4b8e-b43d-98c284484412"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:35:19.786500 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:19.786473    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dcf160e-0f33-4b8e-b43d-98c284484412-kube-api-access-mcxwn" (OuterVolumeSpecName: "kube-api-access-mcxwn") pod "4dcf160e-0f33-4b8e-b43d-98c284484412" (UID: "4dcf160e-0f33-4b8e-b43d-98c284484412"). InnerVolumeSpecName "kube-api-access-mcxwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:35:19.885791 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:19.885748    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcxwn\" (UniqueName: \"kubernetes.io/projected/4dcf160e-0f33-4b8e-b43d-98c284484412-kube-api-access-mcxwn\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:35:19.885791 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:19.885778    2524 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4dcf160e-0f33-4b8e-b43d-98c284484412-extensions-socket-volume\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:35:20.060796 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.060716    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dcf160e-0f33-4b8e-b43d-98c284484412" path="/var/lib/kubelet/pods/4dcf160e-0f33-4b8e-b43d-98c284484412/volumes"
Jul 21 16:35:20.229991 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.229948    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll" event={"ID":"7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5","Type":"ContainerStarted","Data":"ba246d9c442d9a224558c7bbc4708d873f119b14b36899eea3db2ac796d765d8"}
Jul 21 16:35:20.231439 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.231356    2524 generic.go:356] "Generic (PLEG): container finished" podID="4dcf160e-0f33-4b8e-b43d-98c284484412" containerID="0b71938f044d19837461c08e6e4c52eb692e1f843e2dbc751ebcc872d4f601fe" exitCode=0
Jul 21 16:35:20.231439 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.231405    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vb9d6"
Jul 21 16:35:20.231666 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.231457    2524 scope.go:117] "RemoveContainer" containerID="0b71938f044d19837461c08e6e4c52eb692e1f843e2dbc751ebcc872d4f601fe"
Jul 21 16:35:20.233811 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.233753    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z" event={"ID":"dd366d49-58c4-4396-a669-aea0f05a7252","Type":"ContainerStarted","Data":"8572f534d0369a6e1a80bd6cd693c7203bb84981043864486a7fcec9be6de0c4"}
Jul 21 16:35:20.233931 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.233813    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z" event={"ID":"dd366d49-58c4-4396-a669-aea0f05a7252","Type":"ContainerStarted","Data":"0191acff08d45989a8bff78c43ee475f622a00f9b92f1790f2c478b512528df6"}
Jul 21 16:35:20.233977 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.233934    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"
Jul 21 16:35:20.235751 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.235726    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l" event={"ID":"c6aac9d0-5e77-4c04-90c7-539e8279ac7c","Type":"ContainerStarted","Data":"4d8c8a55abbab15e39b98911392805ccd2df33359c37bc8ab595bb172af7f46d"}
Jul 21 16:35:20.235858 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.235775    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l" event={"ID":"c6aac9d0-5e77-4c04-90c7-539e8279ac7c","Type":"ContainerStarted","Data":"331bdb1e680b596792cb82231fba804ec0da0377c456a395bc696c5fa6cc5494"}
Jul 21 16:35:20.235858 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.235806    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"
Jul 21 16:35:20.241377 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.241356    2524 scope.go:117] "RemoveContainer" containerID="0b71938f044d19837461c08e6e4c52eb692e1f843e2dbc751ebcc872d4f601fe"
Jul 21 16:35:20.241713 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:35:20.241691    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b71938f044d19837461c08e6e4c52eb692e1f843e2dbc751ebcc872d4f601fe\": container with ID starting with 0b71938f044d19837461c08e6e4c52eb692e1f843e2dbc751ebcc872d4f601fe not found: ID does not exist" containerID="0b71938f044d19837461c08e6e4c52eb692e1f843e2dbc751ebcc872d4f601fe"
Jul 21 16:35:20.241778 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.241722    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b71938f044d19837461c08e6e4c52eb692e1f843e2dbc751ebcc872d4f601fe"} err="failed to get container status \"0b71938f044d19837461c08e6e4c52eb692e1f843e2dbc751ebcc872d4f601fe\": rpc error: code = NotFound desc = could not find container \"0b71938f044d19837461c08e6e4c52eb692e1f843e2dbc751ebcc872d4f601fe\": container with ID starting with 0b71938f044d19837461c08e6e4c52eb692e1f843e2dbc751ebcc872d4f601fe not found: ID does not exist"
Jul 21 16:35:20.249826 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.249777    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vk5ll" podStartSLOduration=1.348991718 podStartE2EDuration="22.249761967s" totalImagesPullingTime="20.900770249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:20.247839365 +0000 UTC m=+420.644070148" watchObservedRunningTime="2026-07-21 16:35:20.249761967 +0000 UTC m=+420.645992747"
Jul 21 16:35:20.266475 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.266420    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l" podStartSLOduration=11.266399809 podStartE2EDuration="11.266399809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:20.265887415 +0000 UTC m=+420.662118208" watchObservedRunningTime="2026-07-21 16:35:20.266399809 +0000 UTC m=+420.662630591"
Jul 21 16:35:20.293207 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:20.293154    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z" podStartSLOduration=12.293136305 podStartE2EDuration="12.293136305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:20.291893608 +0000 UTC m=+420.688124388" watchObservedRunningTime="2026-07-21 16:35:20.293136305 +0000 UTC m=+420.689367086"
Jul 21 16:35:31.244894 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:31.244863    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"
Jul 21 16:35:31.245525 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:31.245060    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"
Jul 21 16:35:31.315820 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:31.315784    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"]
Jul 21 16:35:31.315994 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:31.315957    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z" podUID="dd366d49-58c4-4396-a669-aea0f05a7252" containerName="manager" containerID="cri-o://8572f534d0369a6e1a80bd6cd693c7203bb84981043864486a7fcec9be6de0c4" gracePeriod=10
Jul 21 16:35:31.566378 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:31.566352    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"
Jul 21 16:35:31.696623 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:31.696593    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv6mg\" (UniqueName: \"kubernetes.io/projected/dd366d49-58c4-4396-a669-aea0f05a7252-kube-api-access-mv6mg\") pod \"dd366d49-58c4-4396-a669-aea0f05a7252\" (UID: \"dd366d49-58c4-4396-a669-aea0f05a7252\") "
Jul 21 16:35:31.696802 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:31.696712    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd366d49-58c4-4396-a669-aea0f05a7252-extensions-socket-volume\") pod \"dd366d49-58c4-4396-a669-aea0f05a7252\" (UID: \"dd366d49-58c4-4396-a669-aea0f05a7252\") "
Jul 21 16:35:31.697111 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:31.697082    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd366d49-58c4-4396-a669-aea0f05a7252-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dd366d49-58c4-4396-a669-aea0f05a7252" (UID: "dd366d49-58c4-4396-a669-aea0f05a7252"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:35:31.698886 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:31.698864    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd366d49-58c4-4396-a669-aea0f05a7252-kube-api-access-mv6mg" (OuterVolumeSpecName: "kube-api-access-mv6mg") pod "dd366d49-58c4-4396-a669-aea0f05a7252" (UID: "dd366d49-58c4-4396-a669-aea0f05a7252"). InnerVolumeSpecName "kube-api-access-mv6mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:35:31.798240 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:31.798148    2524 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dd366d49-58c4-4396-a669-aea0f05a7252-extensions-socket-volume\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:35:31.798240 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:31.798180    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv6mg\" (UniqueName: \"kubernetes.io/projected/dd366d49-58c4-4396-a669-aea0f05a7252-kube-api-access-mv6mg\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:35:32.308526 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:32.308466    2524 generic.go:356] "Generic (PLEG): container finished" podID="dd366d49-58c4-4396-a669-aea0f05a7252" containerID="8572f534d0369a6e1a80bd6cd693c7203bb84981043864486a7fcec9be6de0c4" exitCode=0
Jul 21 16:35:32.308922 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:32.308535    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"
Jul 21 16:35:32.308922 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:32.308542    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z" event={"ID":"dd366d49-58c4-4396-a669-aea0f05a7252","Type":"ContainerDied","Data":"8572f534d0369a6e1a80bd6cd693c7203bb84981043864486a7fcec9be6de0c4"}
Jul 21 16:35:32.308922 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:32.308600    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z" event={"ID":"dd366d49-58c4-4396-a669-aea0f05a7252","Type":"ContainerDied","Data":"0191acff08d45989a8bff78c43ee475f622a00f9b92f1790f2c478b512528df6"}
Jul 21 16:35:32.308922 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:32.308633    2524 scope.go:117] "RemoveContainer" containerID="8572f534d0369a6e1a80bd6cd693c7203bb84981043864486a7fcec9be6de0c4"
Jul 21 16:35:32.318141 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:32.317931    2524 scope.go:117] "RemoveContainer" containerID="8572f534d0369a6e1a80bd6cd693c7203bb84981043864486a7fcec9be6de0c4"
Jul 21 16:35:32.318226 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:35:32.318208    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8572f534d0369a6e1a80bd6cd693c7203bb84981043864486a7fcec9be6de0c4\": container with ID starting with 8572f534d0369a6e1a80bd6cd693c7203bb84981043864486a7fcec9be6de0c4 not found: ID does not exist" containerID="8572f534d0369a6e1a80bd6cd693c7203bb84981043864486a7fcec9be6de0c4"
Jul 21 16:35:32.318270 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:32.318237    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8572f534d0369a6e1a80bd6cd693c7203bb84981043864486a7fcec9be6de0c4"} err="failed to get container status \"8572f534d0369a6e1a80bd6cd693c7203bb84981043864486a7fcec9be6de0c4\": rpc error: code = NotFound desc = could not find container \"8572f534d0369a6e1a80bd6cd693c7203bb84981043864486a7fcec9be6de0c4\": container with ID starting with 8572f534d0369a6e1a80bd6cd693c7203bb84981043864486a7fcec9be6de0c4 not found: ID does not exist"
Jul 21 16:35:32.335084 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:32.335054    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"]
Jul 21 16:35:32.339769 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:32.339736    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nzl7z"]
Jul 21 16:35:34.060220 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:34.060186    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd366d49-58c4-4396-a669-aea0f05a7252" path="/var/lib/kubelet/pods/dd366d49-58c4-4396-a669-aea0f05a7252/volumes"
Jul 21 16:35:47.663680 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.663573    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"]
Jul 21 16:35:47.664326 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.664304    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd366d49-58c4-4396-a669-aea0f05a7252" containerName="manager"
Jul 21 16:35:47.664326 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.664328    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd366d49-58c4-4396-a669-aea0f05a7252" containerName="manager"
Jul 21 16:35:47.664487 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.664474    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd366d49-58c4-4396-a669-aea0f05a7252" containerName="manager"
Jul 21 16:35:47.736343 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.736300    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"]
Jul 21 16:35:47.736549 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.736414    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.738983 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.738961    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5k7nx\""
Jul 21 16:35:47.848450 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.848413    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0390849d-de27-4991-81bc-3d3156217d98-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.848450 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.848454    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0390849d-de27-4991-81bc-3d3156217d98-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.848672 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.848592    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0390849d-de27-4991-81bc-3d3156217d98-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.848672 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.848633    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0390849d-de27-4991-81bc-3d3156217d98-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.848672 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.848659    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0390849d-de27-4991-81bc-3d3156217d98-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.848773 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.848750    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0390849d-de27-4991-81bc-3d3156217d98-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.848806 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.848771    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0390849d-de27-4991-81bc-3d3156217d98-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.848806 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.848792    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrp2n\" (UniqueName: \"kubernetes.io/projected/0390849d-de27-4991-81bc-3d3156217d98-kube-api-access-qrp2n\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.848870 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.848816    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0390849d-de27-4991-81bc-3d3156217d98-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.950384 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.950283    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0390849d-de27-4991-81bc-3d3156217d98-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.950384 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.950327    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0390849d-de27-4991-81bc-3d3156217d98-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.950384 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.950358    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0390849d-de27-4991-81bc-3d3156217d98-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.950655 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.950477    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0390849d-de27-4991-81bc-3d3156217d98-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.950655 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.950539    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0390849d-de27-4991-81bc-3d3156217d98-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.950655 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.950637    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0390849d-de27-4991-81bc-3d3156217d98-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.950812 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.950663    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0390849d-de27-4991-81bc-3d3156217d98-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.950812 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.950698    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrp2n\" (UniqueName: \"kubernetes.io/projected/0390849d-de27-4991-81bc-3d3156217d98-kube-api-access-qrp2n\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.950812 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.950732    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0390849d-de27-4991-81bc-3d3156217d98-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.950812 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.950743    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0390849d-de27-4991-81bc-3d3156217d98-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.950812 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.950788    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0390849d-de27-4991-81bc-3d3156217d98-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.951071 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.950890    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0390849d-de27-4991-81bc-3d3156217d98-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.951071 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.951044    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0390849d-de27-4991-81bc-3d3156217d98-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.951396 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.951373    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0390849d-de27-4991-81bc-3d3156217d98-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.953180 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.953150    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0390849d-de27-4991-81bc-3d3156217d98-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.953361 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.953343    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0390849d-de27-4991-81bc-3d3156217d98-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.959564 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.959539    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0390849d-de27-4991-81bc-3d3156217d98-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:47.959657 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:47.959613    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrp2n\" (UniqueName: \"kubernetes.io/projected/0390849d-de27-4991-81bc-3d3156217d98-kube-api-access-qrp2n\") pod \"maas-default-gateway-openshift-default-56654dcf7-hs8sg\" (UID: \"0390849d-de27-4991-81bc-3d3156217d98\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:48.046602 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:48.046567    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:48.197547 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:48.197502    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"]
Jul 21 16:35:48.198914 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:35:48.198884    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0390849d_de27_4991_81bc_3d3156217d98.slice/crio-52494c0476906ef8d0d5166b4375ca616e07a21e2258aebef6c13c64f39dedf7 WatchSource:0}: Error finding container 52494c0476906ef8d0d5166b4375ca616e07a21e2258aebef6c13c64f39dedf7: Status 404 returned error can't find the container with id 52494c0476906ef8d0d5166b4375ca616e07a21e2258aebef6c13c64f39dedf7
Jul 21 16:35:48.201292 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:48.201258    2524 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 21 16:35:48.201382 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:48.201340    2524 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 21 16:35:48.201382 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:48.201369    2524 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 21 16:35:48.405294 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:48.405251    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg" event={"ID":"0390849d-de27-4991-81bc-3d3156217d98","Type":"ContainerStarted","Data":"7c7ab3382c195e0a32222c6ec1532c78462198974927f5d281005ddcd8a5bb69"}
Jul 21 16:35:48.405474 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:48.405321    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg" event={"ID":"0390849d-de27-4991-81bc-3d3156217d98","Type":"ContainerStarted","Data":"52494c0476906ef8d0d5166b4375ca616e07a21e2258aebef6c13c64f39dedf7"}
Jul 21 16:35:48.427788 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:48.427725    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg" podStartSLOduration=1.427699021 podStartE2EDuration="1.427699021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:48.426121846 +0000 UTC m=+448.822352628" watchObservedRunningTime="2026-07-21 16:35:48.427699021 +0000 UTC m=+448.823929803"
Jul 21 16:35:49.047379 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.047343    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:49.052048 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.052023    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:49.401849 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.401734    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"]
Jul 21 16:35:49.421387 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.421343    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:49.421387 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.421387    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"]
Jul 21 16:35:49.421611 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.421465    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:35:49.421611 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.421541    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"
Jul 21 16:35:49.423869 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.423836    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 16:35:49.463591 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.463551    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7d8q\" (UniqueName: \"kubernetes.io/projected/b0fc01a7-c96a-480a-93f8-982dfb01a34a-kube-api-access-r7d8q\") pod \"limitador-limitador-64c94fd64f-wz5xx\" (UID: \"b0fc01a7-c96a-480a-93f8-982dfb01a34a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"
Jul 21 16:35:49.463839 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.463626    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0fc01a7-c96a-480a-93f8-982dfb01a34a-config-file\") pod \"limitador-limitador-64c94fd64f-wz5xx\" (UID: \"b0fc01a7-c96a-480a-93f8-982dfb01a34a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"
Jul 21 16:35:49.498336 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.498298    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"]
Jul 21 16:35:49.564482 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.564438    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7d8q\" (UniqueName: \"kubernetes.io/projected/b0fc01a7-c96a-480a-93f8-982dfb01a34a-kube-api-access-r7d8q\") pod \"limitador-limitador-64c94fd64f-wz5xx\" (UID: \"b0fc01a7-c96a-480a-93f8-982dfb01a34a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"
Jul 21 16:35:49.564695 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.564499    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0fc01a7-c96a-480a-93f8-982dfb01a34a-config-file\") pod \"limitador-limitador-64c94fd64f-wz5xx\" (UID: \"b0fc01a7-c96a-480a-93f8-982dfb01a34a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"
Jul 21 16:35:49.565165 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.565146    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0fc01a7-c96a-480a-93f8-982dfb01a34a-config-file\") pod \"limitador-limitador-64c94fd64f-wz5xx\" (UID: \"b0fc01a7-c96a-480a-93f8-982dfb01a34a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"
Jul 21 16:35:49.573182 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.573155    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7d8q\" (UniqueName: \"kubernetes.io/projected/b0fc01a7-c96a-480a-93f8-982dfb01a34a-kube-api-access-r7d8q\") pod \"limitador-limitador-64c94fd64f-wz5xx\" (UID: \"b0fc01a7-c96a-480a-93f8-982dfb01a34a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"
Jul 21 16:35:49.734711 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.734601    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"
Jul 21 16:35:49.929679 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:49.929583    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"]
Jul 21 16:35:49.931932 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:35:49.931904    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0fc01a7_c96a_480a_93f8_982dfb01a34a.slice/crio-8987be41edde315dc92f0c1d916710163ab3831b41f30559c6bb3ed973f8b664 WatchSource:0}: Error finding container 8987be41edde315dc92f0c1d916710163ab3831b41f30559c6bb3ed973f8b664: Status 404 returned error can't find the container with id 8987be41edde315dc92f0c1d916710163ab3831b41f30559c6bb3ed973f8b664
Jul 21 16:35:50.208789 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.208756    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-9qhcg"]
Jul 21 16:35:50.242471 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.242431    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9qhcg"]
Jul 21 16:35:50.242654 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.242544    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9qhcg"
Jul 21 16:35:50.245030 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.245008    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zxr8s\""
Jul 21 16:35:50.269706 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.269656    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nwfz\" (UniqueName: \"kubernetes.io/projected/7a49bbd0-9e63-40e9-88fe-47728b999b83-kube-api-access-4nwfz\") pod \"authorino-58cd955675-9qhcg\" (UID: \"7a49bbd0-9e63-40e9-88fe-47728b999b83\") " pod="kuadrant-system/authorino-58cd955675-9qhcg"
Jul 21 16:35:50.370727 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.370682    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nwfz\" (UniqueName: \"kubernetes.io/projected/7a49bbd0-9e63-40e9-88fe-47728b999b83-kube-api-access-4nwfz\") pod \"authorino-58cd955675-9qhcg\" (UID: \"7a49bbd0-9e63-40e9-88fe-47728b999b83\") " pod="kuadrant-system/authorino-58cd955675-9qhcg"
Jul 21 16:35:50.379161 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.379125    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nwfz\" (UniqueName: \"kubernetes.io/projected/7a49bbd0-9e63-40e9-88fe-47728b999b83-kube-api-access-4nwfz\") pod \"authorino-58cd955675-9qhcg\" (UID: \"7a49bbd0-9e63-40e9-88fe-47728b999b83\") " pod="kuadrant-system/authorino-58cd955675-9qhcg"
Jul 21 16:35:50.408352 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.408318    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zcqhg"]
Jul 21 16:35:50.424459 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.424418    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zcqhg"]
Jul 21 16:35:50.424668 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.424463    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx" event={"ID":"b0fc01a7-c96a-480a-93f8-982dfb01a34a","Type":"ContainerStarted","Data":"8987be41edde315dc92f0c1d916710163ab3831b41f30559c6bb3ed973f8b664"}
Jul 21 16:35:50.424668 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.424560    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zcqhg"
Jul 21 16:35:50.472304 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.472215    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrw4t\" (UniqueName: \"kubernetes.io/projected/0bc1f898-85ca-4132-a1c5-2a023785097e-kube-api-access-rrw4t\") pod \"authorino-75d556bd77-zcqhg\" (UID: \"0bc1f898-85ca-4132-a1c5-2a023785097e\") " pod="kuadrant-system/authorino-75d556bd77-zcqhg"
Jul 21 16:35:50.552929 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.552890    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9qhcg"
Jul 21 16:35:50.573637 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.573606    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrw4t\" (UniqueName: \"kubernetes.io/projected/0bc1f898-85ca-4132-a1c5-2a023785097e-kube-api-access-rrw4t\") pod \"authorino-75d556bd77-zcqhg\" (UID: \"0bc1f898-85ca-4132-a1c5-2a023785097e\") " pod="kuadrant-system/authorino-75d556bd77-zcqhg"
Jul 21 16:35:50.581706 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.581656    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrw4t\" (UniqueName: \"kubernetes.io/projected/0bc1f898-85ca-4132-a1c5-2a023785097e-kube-api-access-rrw4t\") pod \"authorino-75d556bd77-zcqhg\" (UID: \"0bc1f898-85ca-4132-a1c5-2a023785097e\") " pod="kuadrant-system/authorino-75d556bd77-zcqhg"
Jul 21 16:35:50.706474 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.706450    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9qhcg"]
Jul 21 16:35:50.708291 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:35:50.708265    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a49bbd0_9e63_40e9_88fe_47728b999b83.slice/crio-657efba39c2ce39b9d7814b73d09286c8ed22660a6b726d39a5569c3d412466f WatchSource:0}: Error finding container 657efba39c2ce39b9d7814b73d09286c8ed22660a6b726d39a5569c3d412466f: Status 404 returned error can't find the container with id 657efba39c2ce39b9d7814b73d09286c8ed22660a6b726d39a5569c3d412466f
Jul 21 16:35:50.735575 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.735477    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zcqhg"
Jul 21 16:35:50.897857 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:50.897828    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zcqhg"]
Jul 21 16:35:50.899813 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:35:50.899783    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bc1f898_85ca_4132_a1c5_2a023785097e.slice/crio-f5a4056f1ef6d4e532680df0c5bd7dd5cbb27dd3de5929d7a1150319f8811383 WatchSource:0}: Error finding container f5a4056f1ef6d4e532680df0c5bd7dd5cbb27dd3de5929d7a1150319f8811383: Status 404 returned error can't find the container with id f5a4056f1ef6d4e532680df0c5bd7dd5cbb27dd3de5929d7a1150319f8811383
Jul 21 16:35:51.430421 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:51.430384    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zcqhg" event={"ID":"0bc1f898-85ca-4132-a1c5-2a023785097e","Type":"ContainerStarted","Data":"f5a4056f1ef6d4e532680df0c5bd7dd5cbb27dd3de5929d7a1150319f8811383"}
Jul 21 16:35:51.432063 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:51.432008    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9qhcg" event={"ID":"7a49bbd0-9e63-40e9-88fe-47728b999b83","Type":"ContainerStarted","Data":"657efba39c2ce39b9d7814b73d09286c8ed22660a6b726d39a5569c3d412466f"}
Jul 21 16:35:56.482204 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:56.482037    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx" event={"ID":"b0fc01a7-c96a-480a-93f8-982dfb01a34a","Type":"ContainerStarted","Data":"a4e748b1e5003bb975182cefd9796e629b816ca4a9fe5754787299d0d0927ddf"}
Jul 21 16:35:56.482204 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:56.482107    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"
Jul 21 16:35:56.483807 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:56.483774    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zcqhg" event={"ID":"0bc1f898-85ca-4132-a1c5-2a023785097e","Type":"ContainerStarted","Data":"bee846d123e24db16ee0750fff557236b8666ee63397927f83126e896f2214b6"}
Jul 21 16:35:56.485303 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:56.485280    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9qhcg" event={"ID":"7a49bbd0-9e63-40e9-88fe-47728b999b83","Type":"ContainerStarted","Data":"fa388af06065749b4910fa2541602c20e3a009e0f3f74c428ce756f7fdc5a2c8"}
Jul 21 16:35:56.499920 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:56.499867    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx" podStartSLOduration=1.302539755 podStartE2EDuration="7.49985068s" totalImagesPullingTime="6.197310925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:56.498551504 +0000 UTC m=+456.894782287" watchObservedRunningTime="2026-07-21 16:35:56.49985068 +0000 UTC m=+456.896081460"
Jul 21 16:35:56.513404 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:56.513350    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zcqhg" podStartSLOduration=1.347992399 podStartE2EDuration="6.513334026s" totalImagesPullingTime="5.165341627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:56.512801364 +0000 UTC m=+456.909032146" watchObservedRunningTime="2026-07-21 16:35:56.513334026 +0000 UTC m=+456.909564853"
Jul 21 16:35:56.530574 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:56.530492    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-9qhcg" podStartSLOduration=1.173970625 podStartE2EDuration="6.530468877s" totalImagesPullingTime="5.356498252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:56.529544316 +0000 UTC m=+456.925775095" watchObservedRunningTime="2026-07-21 16:35:56.530468877 +0000 UTC m=+456.926699659"
Jul 21 16:35:56.555321 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:56.555276    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9qhcg"]
Jul 21 16:35:58.496773 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:58.496732    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-9qhcg" podUID="7a49bbd0-9e63-40e9-88fe-47728b999b83" containerName="authorino" containerID="cri-o://fa388af06065749b4910fa2541602c20e3a009e0f3f74c428ce756f7fdc5a2c8" gracePeriod=30
Jul 21 16:35:58.754373 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:58.754301    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9qhcg"
Jul 21 16:35:58.858230 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:58.858197    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nwfz\" (UniqueName: \"kubernetes.io/projected/7a49bbd0-9e63-40e9-88fe-47728b999b83-kube-api-access-4nwfz\") pod \"7a49bbd0-9e63-40e9-88fe-47728b999b83\" (UID: \"7a49bbd0-9e63-40e9-88fe-47728b999b83\") "
Jul 21 16:35:58.860471 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:58.860443    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a49bbd0-9e63-40e9-88fe-47728b999b83-kube-api-access-4nwfz" (OuterVolumeSpecName: "kube-api-access-4nwfz") pod "7a49bbd0-9e63-40e9-88fe-47728b999b83" (UID: "7a49bbd0-9e63-40e9-88fe-47728b999b83"). InnerVolumeSpecName "kube-api-access-4nwfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:35:58.959551 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:58.959487    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nwfz\" (UniqueName: \"kubernetes.io/projected/7a49bbd0-9e63-40e9-88fe-47728b999b83-kube-api-access-4nwfz\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:35:59.503094 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:59.503057    2524 generic.go:356] "Generic (PLEG): container finished" podID="7a49bbd0-9e63-40e9-88fe-47728b999b83" containerID="fa388af06065749b4910fa2541602c20e3a009e0f3f74c428ce756f7fdc5a2c8" exitCode=0
Jul 21 16:35:59.503094 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:59.503100    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9qhcg"
Jul 21 16:35:59.503589 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:59.503125    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9qhcg" event={"ID":"7a49bbd0-9e63-40e9-88fe-47728b999b83","Type":"ContainerDied","Data":"fa388af06065749b4910fa2541602c20e3a009e0f3f74c428ce756f7fdc5a2c8"}
Jul 21 16:35:59.503589 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:59.503157    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9qhcg" event={"ID":"7a49bbd0-9e63-40e9-88fe-47728b999b83","Type":"ContainerDied","Data":"657efba39c2ce39b9d7814b73d09286c8ed22660a6b726d39a5569c3d412466f"}
Jul 21 16:35:59.503589 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:59.503174    2524 scope.go:117] "RemoveContainer" containerID="fa388af06065749b4910fa2541602c20e3a009e0f3f74c428ce756f7fdc5a2c8"
Jul 21 16:35:59.513644 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:59.513618    2524 scope.go:117] "RemoveContainer" containerID="fa388af06065749b4910fa2541602c20e3a009e0f3f74c428ce756f7fdc5a2c8"
Jul 21 16:35:59.513940 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:35:59.513922    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa388af06065749b4910fa2541602c20e3a009e0f3f74c428ce756f7fdc5a2c8\": container with ID starting with fa388af06065749b4910fa2541602c20e3a009e0f3f74c428ce756f7fdc5a2c8 not found: ID does not exist" containerID="fa388af06065749b4910fa2541602c20e3a009e0f3f74c428ce756f7fdc5a2c8"
Jul 21 16:35:59.514001 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:59.513954    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa388af06065749b4910fa2541602c20e3a009e0f3f74c428ce756f7fdc5a2c8"} err="failed to get container status \"fa388af06065749b4910fa2541602c20e3a009e0f3f74c428ce756f7fdc5a2c8\": rpc error: code = NotFound desc = could not find container \"fa388af06065749b4910fa2541602c20e3a009e0f3f74c428ce756f7fdc5a2c8\": container with ID starting with fa388af06065749b4910fa2541602c20e3a009e0f3f74c428ce756f7fdc5a2c8 not found: ID does not exist"
Jul 21 16:35:59.524818 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:59.524784    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9qhcg"]
Jul 21 16:35:59.529207 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:35:59.529179    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-9qhcg"]
Jul 21 16:36:00.061102 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:00.061065    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a49bbd0-9e63-40e9-88fe-47728b999b83" path="/var/lib/kubelet/pods/7a49bbd0-9e63-40e9-88fe-47728b999b83/volumes"
Jul 21 16:36:04.649475 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:04.649436    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"]
Jul 21 16:36:04.649996 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:04.649701    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx" podUID="b0fc01a7-c96a-480a-93f8-982dfb01a34a" containerName="limitador" containerID="cri-o://a4e748b1e5003bb975182cefd9796e629b816ca4a9fe5754787299d0d0927ddf" gracePeriod=30
Jul 21 16:36:04.651963 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:04.651938    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"
Jul 21 16:36:05.213247 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.213161    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"
Jul 21 16:36:05.319180 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.319147    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0fc01a7-c96a-480a-93f8-982dfb01a34a-config-file\") pod \"b0fc01a7-c96a-480a-93f8-982dfb01a34a\" (UID: \"b0fc01a7-c96a-480a-93f8-982dfb01a34a\") "
Jul 21 16:36:05.319396 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.319233    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7d8q\" (UniqueName: \"kubernetes.io/projected/b0fc01a7-c96a-480a-93f8-982dfb01a34a-kube-api-access-r7d8q\") pod \"b0fc01a7-c96a-480a-93f8-982dfb01a34a\" (UID: \"b0fc01a7-c96a-480a-93f8-982dfb01a34a\") "
Jul 21 16:36:05.319630 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.319605    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0fc01a7-c96a-480a-93f8-982dfb01a34a-config-file" (OuterVolumeSpecName: "config-file") pod "b0fc01a7-c96a-480a-93f8-982dfb01a34a" (UID: "b0fc01a7-c96a-480a-93f8-982dfb01a34a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:36:05.321570 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.321547    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0fc01a7-c96a-480a-93f8-982dfb01a34a-kube-api-access-r7d8q" (OuterVolumeSpecName: "kube-api-access-r7d8q") pod "b0fc01a7-c96a-480a-93f8-982dfb01a34a" (UID: "b0fc01a7-c96a-480a-93f8-982dfb01a34a"). InnerVolumeSpecName "kube-api-access-r7d8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:36:05.420259 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.420201    2524 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b0fc01a7-c96a-480a-93f8-982dfb01a34a-config-file\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:36:05.420259 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.420252    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7d8q\" (UniqueName: \"kubernetes.io/projected/b0fc01a7-c96a-480a-93f8-982dfb01a34a-kube-api-access-r7d8q\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:36:05.538851 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.538817    2524 generic.go:356] "Generic (PLEG): container finished" podID="b0fc01a7-c96a-480a-93f8-982dfb01a34a" containerID="a4e748b1e5003bb975182cefd9796e629b816ca4a9fe5754787299d0d0927ddf" exitCode=0
Jul 21 16:36:05.539003 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.538863    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"
Jul 21 16:36:05.539003 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.538910    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx" event={"ID":"b0fc01a7-c96a-480a-93f8-982dfb01a34a","Type":"ContainerDied","Data":"a4e748b1e5003bb975182cefd9796e629b816ca4a9fe5754787299d0d0927ddf"}
Jul 21 16:36:05.539003 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.538968    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wz5xx" event={"ID":"b0fc01a7-c96a-480a-93f8-982dfb01a34a","Type":"ContainerDied","Data":"8987be41edde315dc92f0c1d916710163ab3831b41f30559c6bb3ed973f8b664"}
Jul 21 16:36:05.539003 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.538996    2524 scope.go:117] "RemoveContainer" containerID="a4e748b1e5003bb975182cefd9796e629b816ca4a9fe5754787299d0d0927ddf"
Jul 21 16:36:05.548863 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.548842    2524 scope.go:117] "RemoveContainer" containerID="a4e748b1e5003bb975182cefd9796e629b816ca4a9fe5754787299d0d0927ddf"
Jul 21 16:36:05.549168 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:36:05.549148    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4e748b1e5003bb975182cefd9796e629b816ca4a9fe5754787299d0d0927ddf\": container with ID starting with a4e748b1e5003bb975182cefd9796e629b816ca4a9fe5754787299d0d0927ddf not found: ID does not exist" containerID="a4e748b1e5003bb975182cefd9796e629b816ca4a9fe5754787299d0d0927ddf"
Jul 21 16:36:05.549241 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.549176    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e748b1e5003bb975182cefd9796e629b816ca4a9fe5754787299d0d0927ddf"} err="failed to get container status \"a4e748b1e5003bb975182cefd9796e629b816ca4a9fe5754787299d0d0927ddf\": rpc error: code = NotFound desc = could not find container \"a4e748b1e5003bb975182cefd9796e629b816ca4a9fe5754787299d0d0927ddf\": container with ID starting with a4e748b1e5003bb975182cefd9796e629b816ca4a9fe5754787299d0d0927ddf not found: ID does not exist"
Jul 21 16:36:05.560726 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.560702    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"]
Jul 21 16:36:05.565195 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:05.565170    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wz5xx"]
Jul 21 16:36:06.061875 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:06.061839    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0fc01a7-c96a-480a-93f8-982dfb01a34a" path="/var/lib/kubelet/pods/b0fc01a7-c96a-480a-93f8-982dfb01a34a/volumes"
Jul 21 16:36:11.046976 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.046936    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-thqlx"]
Jul 21 16:36:11.047620 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.047602    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a49bbd0-9e63-40e9-88fe-47728b999b83" containerName="authorino"
Jul 21 16:36:11.047679 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.047623    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a49bbd0-9e63-40e9-88fe-47728b999b83" containerName="authorino"
Jul 21 16:36:11.047679 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.047647    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0fc01a7-c96a-480a-93f8-982dfb01a34a" containerName="limitador"
Jul 21 16:36:11.047679 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.047656    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0fc01a7-c96a-480a-93f8-982dfb01a34a" containerName="limitador"
Jul 21 16:36:11.047783 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.047748    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0fc01a7-c96a-480a-93f8-982dfb01a34a" containerName="limitador"
Jul 21 16:36:11.047783 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.047763    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a49bbd0-9e63-40e9-88fe-47728b999b83" containerName="authorino"
Jul 21 16:36:11.052559 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.052539    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-thqlx"
Jul 21 16:36:11.055170 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.055147    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 21 16:36:11.056144 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.056121    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 16:36:11.056144 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.056132    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 16:36:11.056276 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.056212    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-nzqt5\""
Jul 21 16:36:11.064285 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.064255    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-thqlx"]
Jul 21 16:36:11.180889 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.180838    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c31b0c69-863f-470b-b275-31db7b4101b8-data\") pod \"postgres-69fb4594cf-thqlx\" (UID: \"c31b0c69-863f-470b-b275-31db7b4101b8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-thqlx"
Jul 21 16:36:11.181086 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.180997    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjs8q\" (UniqueName: \"kubernetes.io/projected/c31b0c69-863f-470b-b275-31db7b4101b8-kube-api-access-rjs8q\") pod \"postgres-69fb4594cf-thqlx\" (UID: \"c31b0c69-863f-470b-b275-31db7b4101b8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-thqlx"
Jul 21 16:36:11.281757 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.281708    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjs8q\" (UniqueName: \"kubernetes.io/projected/c31b0c69-863f-470b-b275-31db7b4101b8-kube-api-access-rjs8q\") pod \"postgres-69fb4594cf-thqlx\" (UID: \"c31b0c69-863f-470b-b275-31db7b4101b8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-thqlx"
Jul 21 16:36:11.281943 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.281791    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c31b0c69-863f-470b-b275-31db7b4101b8-data\") pod \"postgres-69fb4594cf-thqlx\" (UID: \"c31b0c69-863f-470b-b275-31db7b4101b8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-thqlx"
Jul 21 16:36:11.282123 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.282108    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c31b0c69-863f-470b-b275-31db7b4101b8-data\") pod \"postgres-69fb4594cf-thqlx\" (UID: \"c31b0c69-863f-470b-b275-31db7b4101b8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-thqlx"
Jul 21 16:36:11.290662 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.290638    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjs8q\" (UniqueName: \"kubernetes.io/projected/c31b0c69-863f-470b-b275-31db7b4101b8-kube-api-access-rjs8q\") pod \"postgres-69fb4594cf-thqlx\" (UID: \"c31b0c69-863f-470b-b275-31db7b4101b8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-thqlx"
Jul 21 16:36:11.363399 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.363295    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-thqlx"
Jul 21 16:36:11.508633 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.508607    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-thqlx"]
Jul 21 16:36:11.511331 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:36:11.511304    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc31b0c69_863f_470b_b275_31db7b4101b8.slice/crio-b2b3c44eed6c60237729d379eeb791d64d5bbdd2690e2fbf4179a898d5ea84d3 WatchSource:0}: Error finding container b2b3c44eed6c60237729d379eeb791d64d5bbdd2690e2fbf4179a898d5ea84d3: Status 404 returned error can't find the container with id b2b3c44eed6c60237729d379eeb791d64d5bbdd2690e2fbf4179a898d5ea84d3
Jul 21 16:36:11.575482 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:11.575444    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-thqlx" event={"ID":"c31b0c69-863f-470b-b275-31db7b4101b8","Type":"ContainerStarted","Data":"b2b3c44eed6c60237729d379eeb791d64d5bbdd2690e2fbf4179a898d5ea84d3"}
Jul 21 16:36:17.621091 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:17.621042    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-thqlx" event={"ID":"c31b0c69-863f-470b-b275-31db7b4101b8","Type":"ContainerStarted","Data":"169796f2f952a6b613645b4466a24e9faf7fc82826a480b8ffcdc1d3d7f56b35"}
Jul 21 16:36:17.621495 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:17.621130    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-thqlx"
Jul 21 16:36:17.638100 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:17.638047    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-thqlx" podStartSLOduration=1.40556515 podStartE2EDuration="6.638030228s" totalImagesPullingTime="5.232465078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:36:17.636056935 +0000 UTC m=+478.032287717" watchObservedRunningTime="2026-07-21 16:36:17.638030228 +0000 UTC m=+478.034261008"
Jul 21 16:36:23.658642 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:23.658601    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-thqlx"
Jul 21 16:36:24.206681 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.206645    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mc6cb"]
Jul 21 16:36:24.214317 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.214281    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mc6cb"
Jul 21 16:36:24.217686 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.217653    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mc6cb"]
Jul 21 16:36:24.309939 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.309900    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h5rn\" (UniqueName: \"kubernetes.io/projected/7ba6e15b-388a-4e30-aa6c-36baf6f55f15-kube-api-access-5h5rn\") pod \"authorino-5d4b67c446-mc6cb\" (UID: \"7ba6e15b-388a-4e30-aa6c-36baf6f55f15\") " pod="kuadrant-system/authorino-5d4b67c446-mc6cb"
Jul 21 16:36:24.411008 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.410967    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h5rn\" (UniqueName: \"kubernetes.io/projected/7ba6e15b-388a-4e30-aa6c-36baf6f55f15-kube-api-access-5h5rn\") pod \"authorino-5d4b67c446-mc6cb\" (UID: \"7ba6e15b-388a-4e30-aa6c-36baf6f55f15\") " pod="kuadrant-system/authorino-5d4b67c446-mc6cb"
Jul 21 16:36:24.422314 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.422283    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h5rn\" (UniqueName: \"kubernetes.io/projected/7ba6e15b-388a-4e30-aa6c-36baf6f55f15-kube-api-access-5h5rn\") pod \"authorino-5d4b67c446-mc6cb\" (UID: \"7ba6e15b-388a-4e30-aa6c-36baf6f55f15\") " pod="kuadrant-system/authorino-5d4b67c446-mc6cb"
Jul 21 16:36:24.454787 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.454745    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mc6cb"]
Jul 21 16:36:24.455116 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.455097    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mc6cb"
Jul 21 16:36:24.600433 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.600400    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-dcd5b4545-zrdtf"]
Jul 21 16:36:24.606092 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:36:24.606067    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ba6e15b_388a_4e30_aa6c_36baf6f55f15.slice/crio-025fbc144c13149c19f3d7dcd678e574a9804c4d6bda8a87b0f90ef632d260c8 WatchSource:0}: Error finding container 025fbc144c13149c19f3d7dcd678e574a9804c4d6bda8a87b0f90ef632d260c8: Status 404 returned error can't find the container with id 025fbc144c13149c19f3d7dcd678e574a9804c4d6bda8a87b0f90ef632d260c8
Jul 21 16:36:24.606659 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.606638    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mc6cb"]
Jul 21 16:36:24.606742 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.606731    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dcd5b4545-zrdtf"
Jul 21 16:36:24.610149 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.610128    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 21 16:36:24.617369 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.617346    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dcd5b4545-zrdtf"]
Jul 21 16:36:24.662943 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.662899    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mc6cb" event={"ID":"7ba6e15b-388a-4e30-aa6c-36baf6f55f15","Type":"ContainerStarted","Data":"025fbc144c13149c19f3d7dcd678e574a9804c4d6bda8a87b0f90ef632d260c8"}
Jul 21 16:36:24.714810 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.714724    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4-tls-cert\") pod \"authorino-dcd5b4545-zrdtf\" (UID: \"93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4\") " pod="kuadrant-system/authorino-dcd5b4545-zrdtf"
Jul 21 16:36:24.714810 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.714771    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m92x\" (UniqueName: \"kubernetes.io/projected/93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4-kube-api-access-6m92x\") pod \"authorino-dcd5b4545-zrdtf\" (UID: \"93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4\") " pod="kuadrant-system/authorino-dcd5b4545-zrdtf"
Jul 21 16:36:24.816022 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.815984    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4-tls-cert\") pod \"authorino-dcd5b4545-zrdtf\" (UID: \"93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4\") " pod="kuadrant-system/authorino-dcd5b4545-zrdtf"
Jul 21 16:36:24.816022 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.816024    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m92x\" (UniqueName: \"kubernetes.io/projected/93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4-kube-api-access-6m92x\") pod \"authorino-dcd5b4545-zrdtf\" (UID: \"93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4\") " pod="kuadrant-system/authorino-dcd5b4545-zrdtf"
Jul 21 16:36:24.818684 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.818646    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4-tls-cert\") pod \"authorino-dcd5b4545-zrdtf\" (UID: \"93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4\") " pod="kuadrant-system/authorino-dcd5b4545-zrdtf"
Jul 21 16:36:24.824103 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.824070    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m92x\" (UniqueName: \"kubernetes.io/projected/93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4-kube-api-access-6m92x\") pod \"authorino-dcd5b4545-zrdtf\" (UID: \"93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4\") " pod="kuadrant-system/authorino-dcd5b4545-zrdtf"
Jul 21 16:36:24.924816 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:24.924778    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dcd5b4545-zrdtf"
Jul 21 16:36:25.069593 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:25.069566    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dcd5b4545-zrdtf"]
Jul 21 16:36:25.071896 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:36:25.071864    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93e4d86d_ecfb_4e4c_aa6e_bdd6dd7512a4.slice/crio-ba2b79264818cab63dd4d936e9a36d36f1f1051b2c1e407cfcd040e436f83099 WatchSource:0}: Error finding container ba2b79264818cab63dd4d936e9a36d36f1f1051b2c1e407cfcd040e436f83099: Status 404 returned error can't find the container with id ba2b79264818cab63dd4d936e9a36d36f1f1051b2c1e407cfcd040e436f83099
Jul 21 16:36:25.676274 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:25.676158    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dcd5b4545-zrdtf" event={"ID":"93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4","Type":"ContainerStarted","Data":"f2dbca5b7d7bedd7fbba37d627185b2a3daa4b25ddfeb2428416dd8ba991e8ba"}
Jul 21 16:36:25.676274 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:25.676221    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dcd5b4545-zrdtf" event={"ID":"93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4","Type":"ContainerStarted","Data":"ba2b79264818cab63dd4d936e9a36d36f1f1051b2c1e407cfcd040e436f83099"}
Jul 21 16:36:25.677672 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:25.677640    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mc6cb" event={"ID":"7ba6e15b-388a-4e30-aa6c-36baf6f55f15","Type":"ContainerStarted","Data":"68a1ae634dbbff0aacbe0faefd75229adc8b2bd36293acd6c483fe86a2bd15e4"}
Jul 21 16:36:25.677793 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:25.677722    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-mc6cb" podUID="7ba6e15b-388a-4e30-aa6c-36baf6f55f15" containerName="authorino" containerID="cri-o://68a1ae634dbbff0aacbe0faefd75229adc8b2bd36293acd6c483fe86a2bd15e4" gracePeriod=30
Jul 21 16:36:25.695574 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:25.695524    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-dcd5b4545-zrdtf" podStartSLOduration=1.349541944 podStartE2EDuration="1.695487921s" totalImagesPullingTime="345.945977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:36:25.694095429 +0000 UTC m=+486.090326222" watchObservedRunningTime="2026-07-21 16:36:25.695487921 +0000 UTC m=+486.091718679"
Jul 21 16:36:25.710222 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:25.710156    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-mc6cb" podStartSLOduration=1.203299862 podStartE2EDuration="1.710130925s" totalImagesPullingTime="506.831063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:36:25.709993277 +0000 UTC m=+486.106224059" watchObservedRunningTime="2026-07-21 16:36:25.710130925 +0000 UTC m=+486.106361707"
Jul 21 16:36:25.725572 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:25.725531    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zcqhg"]
Jul 21 16:36:25.725767 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:25.725728    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zcqhg" podUID="0bc1f898-85ca-4132-a1c5-2a023785097e" containerName="authorino" containerID="cri-o://bee846d123e24db16ee0750fff557236b8666ee63397927f83126e896f2214b6" gracePeriod=30
Jul 21 16:36:25.966436 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:25.966407    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mc6cb"
Jul 21 16:36:26.001128 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.001100    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zcqhg"
Jul 21 16:36:26.029957 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.029913    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrw4t\" (UniqueName: \"kubernetes.io/projected/0bc1f898-85ca-4132-a1c5-2a023785097e-kube-api-access-rrw4t\") pod \"0bc1f898-85ca-4132-a1c5-2a023785097e\" (UID: \"0bc1f898-85ca-4132-a1c5-2a023785097e\") "
Jul 21 16:36:26.030164 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.029985    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h5rn\" (UniqueName: \"kubernetes.io/projected/7ba6e15b-388a-4e30-aa6c-36baf6f55f15-kube-api-access-5h5rn\") pod \"7ba6e15b-388a-4e30-aa6c-36baf6f55f15\" (UID: \"7ba6e15b-388a-4e30-aa6c-36baf6f55f15\") "
Jul 21 16:36:26.032330 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.032299    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bc1f898-85ca-4132-a1c5-2a023785097e-kube-api-access-rrw4t" (OuterVolumeSpecName: "kube-api-access-rrw4t") pod "0bc1f898-85ca-4132-a1c5-2a023785097e" (UID: "0bc1f898-85ca-4132-a1c5-2a023785097e"). InnerVolumeSpecName "kube-api-access-rrw4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:36:26.032330 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.032303    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ba6e15b-388a-4e30-aa6c-36baf6f55f15-kube-api-access-5h5rn" (OuterVolumeSpecName: "kube-api-access-5h5rn") pod "7ba6e15b-388a-4e30-aa6c-36baf6f55f15" (UID: "7ba6e15b-388a-4e30-aa6c-36baf6f55f15"). InnerVolumeSpecName "kube-api-access-5h5rn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:36:26.131713 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.131679    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrw4t\" (UniqueName: \"kubernetes.io/projected/0bc1f898-85ca-4132-a1c5-2a023785097e-kube-api-access-rrw4t\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:36:26.131713 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.131711    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h5rn\" (UniqueName: \"kubernetes.io/projected/7ba6e15b-388a-4e30-aa6c-36baf6f55f15-kube-api-access-5h5rn\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:36:26.684935 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.684844    2524 generic.go:356] "Generic (PLEG): container finished" podID="0bc1f898-85ca-4132-a1c5-2a023785097e" containerID="bee846d123e24db16ee0750fff557236b8666ee63397927f83126e896f2214b6" exitCode=0
Jul 21 16:36:26.684935 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.684894    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zcqhg"
Jul 21 16:36:26.685476 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.684929    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zcqhg" event={"ID":"0bc1f898-85ca-4132-a1c5-2a023785097e","Type":"ContainerDied","Data":"bee846d123e24db16ee0750fff557236b8666ee63397927f83126e896f2214b6"}
Jul 21 16:36:26.685476 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.684968    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zcqhg" event={"ID":"0bc1f898-85ca-4132-a1c5-2a023785097e","Type":"ContainerDied","Data":"f5a4056f1ef6d4e532680df0c5bd7dd5cbb27dd3de5929d7a1150319f8811383"}
Jul 21 16:36:26.685476 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.684984    2524 scope.go:117] "RemoveContainer" containerID="bee846d123e24db16ee0750fff557236b8666ee63397927f83126e896f2214b6"
Jul 21 16:36:26.686423 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.686401    2524 generic.go:356] "Generic (PLEG): container finished" podID="7ba6e15b-388a-4e30-aa6c-36baf6f55f15" containerID="68a1ae634dbbff0aacbe0faefd75229adc8b2bd36293acd6c483fe86a2bd15e4" exitCode=0
Jul 21 16:36:26.686480 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.686466    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mc6cb"
Jul 21 16:36:26.686566 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.686480    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mc6cb" event={"ID":"7ba6e15b-388a-4e30-aa6c-36baf6f55f15","Type":"ContainerDied","Data":"68a1ae634dbbff0aacbe0faefd75229adc8b2bd36293acd6c483fe86a2bd15e4"}
Jul 21 16:36:26.686757 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.686737    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-mc6cb" event={"ID":"7ba6e15b-388a-4e30-aa6c-36baf6f55f15","Type":"ContainerDied","Data":"025fbc144c13149c19f3d7dcd678e574a9804c4d6bda8a87b0f90ef632d260c8"}
Jul 21 16:36:26.694545 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.694486    2524 scope.go:117] "RemoveContainer" containerID="bee846d123e24db16ee0750fff557236b8666ee63397927f83126e896f2214b6"
Jul 21 16:36:26.694846 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:36:26.694828    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bee846d123e24db16ee0750fff557236b8666ee63397927f83126e896f2214b6\": container with ID starting with bee846d123e24db16ee0750fff557236b8666ee63397927f83126e896f2214b6 not found: ID does not exist" containerID="bee846d123e24db16ee0750fff557236b8666ee63397927f83126e896f2214b6"
Jul 21 16:36:26.694908 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.694856    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bee846d123e24db16ee0750fff557236b8666ee63397927f83126e896f2214b6"} err="failed to get container status \"bee846d123e24db16ee0750fff557236b8666ee63397927f83126e896f2214b6\": rpc error: code = NotFound desc = could not find container \"bee846d123e24db16ee0750fff557236b8666ee63397927f83126e896f2214b6\": container with ID starting with bee846d123e24db16ee0750fff557236b8666ee63397927f83126e896f2214b6 not found: ID does not exist"
Jul 21 16:36:26.694908 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.694878    2524 scope.go:117] "RemoveContainer" containerID="68a1ae634dbbff0aacbe0faefd75229adc8b2bd36293acd6c483fe86a2bd15e4"
Jul 21 16:36:26.703984 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.703959    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zcqhg"]
Jul 21 16:36:26.704060 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.703994    2524 scope.go:117] "RemoveContainer" containerID="68a1ae634dbbff0aacbe0faefd75229adc8b2bd36293acd6c483fe86a2bd15e4"
Jul 21 16:36:26.704329 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:36:26.704312    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68a1ae634dbbff0aacbe0faefd75229adc8b2bd36293acd6c483fe86a2bd15e4\": container with ID starting with 68a1ae634dbbff0aacbe0faefd75229adc8b2bd36293acd6c483fe86a2bd15e4 not found: ID does not exist" containerID="68a1ae634dbbff0aacbe0faefd75229adc8b2bd36293acd6c483fe86a2bd15e4"
Jul 21 16:36:26.704383 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.704335    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68a1ae634dbbff0aacbe0faefd75229adc8b2bd36293acd6c483fe86a2bd15e4"} err="failed to get container status \"68a1ae634dbbff0aacbe0faefd75229adc8b2bd36293acd6c483fe86a2bd15e4\": rpc error: code = NotFound desc = could not find container \"68a1ae634dbbff0aacbe0faefd75229adc8b2bd36293acd6c483fe86a2bd15e4\": container with ID starting with 68a1ae634dbbff0aacbe0faefd75229adc8b2bd36293acd6c483fe86a2bd15e4 not found: ID does not exist"
Jul 21 16:36:26.707607 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.707584    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zcqhg"]
Jul 21 16:36:26.719029 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.719001    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mc6cb"]
Jul 21 16:36:26.723853 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:26.723827    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mc6cb"]
Jul 21 16:36:28.060869 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:28.060836    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bc1f898-85ca-4132-a1c5-2a023785097e" path="/var/lib/kubelet/pods/0bc1f898-85ca-4132-a1c5-2a023785097e/volumes"
Jul 21 16:36:28.061362 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:28.061186    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ba6e15b-388a-4e30-aa6c-36baf6f55f15" path="/var/lib/kubelet/pods/7ba6e15b-388a-4e30-aa6c-36baf6f55f15/volumes"
Jul 21 16:36:30.497343 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.497300    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57669fdb4c-hz2wz"]
Jul 21 16:36:30.497983 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.497966    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc1f898-85ca-4132-a1c5-2a023785097e" containerName="authorino"
Jul 21 16:36:30.498067 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.497988    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc1f898-85ca-4132-a1c5-2a023785097e" containerName="authorino"
Jul 21 16:36:30.498067 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.498002    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ba6e15b-388a-4e30-aa6c-36baf6f55f15" containerName="authorino"
Jul 21 16:36:30.498067 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.498008    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ba6e15b-388a-4e30-aa6c-36baf6f55f15" containerName="authorino"
Jul 21 16:36:30.498169 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.498104    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc1f898-85ca-4132-a1c5-2a023785097e" containerName="authorino"
Jul 21 16:36:30.498169 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.498121    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ba6e15b-388a-4e30-aa6c-36baf6f55f15" containerName="authorino"
Jul 21 16:36:30.709810 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.709784    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57669fdb4c-hz2wz"]
Jul 21 16:36:30.709985 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.709879    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57669fdb4c-hz2wz"
Jul 21 16:36:30.713618 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.713586    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9gnqm\""
Jul 21 16:36:30.713788 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.713656    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 16:36:30.713788 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.713669    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 16:36:30.772793 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.772771    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/671cfafd-e6ea-4e6f-8a7a-c467ee83ad74-webhook-cert\") pod \"maas-controller-57669fdb4c-hz2wz\" (UID: \"671cfafd-e6ea-4e6f-8a7a-c467ee83ad74\") " pod="opendatahub/maas-controller-57669fdb4c-hz2wz"
Jul 21 16:36:30.772892 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.772843    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr9b5\" (UniqueName: \"kubernetes.io/projected/671cfafd-e6ea-4e6f-8a7a-c467ee83ad74-kube-api-access-mr9b5\") pod \"maas-controller-57669fdb4c-hz2wz\" (UID: \"671cfafd-e6ea-4e6f-8a7a-c467ee83ad74\") " pod="opendatahub/maas-controller-57669fdb4c-hz2wz"
Jul 21 16:36:30.873593 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.873570    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/671cfafd-e6ea-4e6f-8a7a-c467ee83ad74-webhook-cert\") pod \"maas-controller-57669fdb4c-hz2wz\" (UID: \"671cfafd-e6ea-4e6f-8a7a-c467ee83ad74\") " pod="opendatahub/maas-controller-57669fdb4c-hz2wz"
Jul 21 16:36:30.873691 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.873643    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr9b5\" (UniqueName: \"kubernetes.io/projected/671cfafd-e6ea-4e6f-8a7a-c467ee83ad74-kube-api-access-mr9b5\") pod \"maas-controller-57669fdb4c-hz2wz\" (UID: \"671cfafd-e6ea-4e6f-8a7a-c467ee83ad74\") " pod="opendatahub/maas-controller-57669fdb4c-hz2wz"
Jul 21 16:36:30.876120 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.876091    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/671cfafd-e6ea-4e6f-8a7a-c467ee83ad74-webhook-cert\") pod \"maas-controller-57669fdb4c-hz2wz\" (UID: \"671cfafd-e6ea-4e6f-8a7a-c467ee83ad74\") " pod="opendatahub/maas-controller-57669fdb4c-hz2wz"
Jul 21 16:36:30.882318 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:30.882299    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr9b5\" (UniqueName: \"kubernetes.io/projected/671cfafd-e6ea-4e6f-8a7a-c467ee83ad74-kube-api-access-mr9b5\") pod \"maas-controller-57669fdb4c-hz2wz\" (UID: \"671cfafd-e6ea-4e6f-8a7a-c467ee83ad74\") " pod="opendatahub/maas-controller-57669fdb4c-hz2wz"
Jul 21 16:36:31.020620 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:31.020593    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57669fdb4c-hz2wz"
Jul 21 16:36:31.196524 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:31.196485    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57669fdb4c-hz2wz"]
Jul 21 16:36:31.197957 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:36:31.197931    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod671cfafd_e6ea_4e6f_8a7a_c467ee83ad74.slice/crio-7f3868cb80e8294f97f44d195051e6009b062bdaaa12bc604d4b90a97775e6cb WatchSource:0}: Error finding container 7f3868cb80e8294f97f44d195051e6009b062bdaaa12bc604d4b90a97775e6cb: Status 404 returned error can't find the container with id 7f3868cb80e8294f97f44d195051e6009b062bdaaa12bc604d4b90a97775e6cb
Jul 21 16:36:31.725546 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:31.725491    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57669fdb4c-hz2wz" event={"ID":"671cfafd-e6ea-4e6f-8a7a-c467ee83ad74","Type":"ContainerStarted","Data":"7f3868cb80e8294f97f44d195051e6009b062bdaaa12bc604d4b90a97775e6cb"}
Jul 21 16:36:33.740650 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:33.740620    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57669fdb4c-hz2wz" event={"ID":"671cfafd-e6ea-4e6f-8a7a-c467ee83ad74","Type":"ContainerStarted","Data":"902996908bc1311b22150a11c4d0faa86c064b246e1b251133283e6d3b5a9340"}
Jul 21 16:36:33.740966 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:33.740708    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57669fdb4c-hz2wz"
Jul 21 16:36:44.748421 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:44.748384    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57669fdb4c-hz2wz"
Jul 21 16:36:44.767913 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:36:44.767856    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57669fdb4c-hz2wz" podStartSLOduration=12.314256574 podStartE2EDuration="14.767840142s" totalImagesPullingTime="2.453583568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:36:33.776347637 +0000 UTC m=+494.172578418" watchObservedRunningTime="2026-07-21 16:36:44.767840142 +0000 UTC m=+505.164070923"
Jul 21 16:37:06.952194 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:06.952156    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-p62qp"]
Jul 21 16:37:06.961369 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:06.961335    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-p62qp"
Jul 21 16:37:06.963000 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:06.962972    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-p62qp"]
Jul 21 16:37:06.964442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:06.964419    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 16:37:06.964904 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:06.964882    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6l449\""
Jul 21 16:37:07.022180 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:07.022150    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw25x\" (UniqueName: \"kubernetes.io/projected/ba91a689-60db-4bb1-b449-65df45c9d879-kube-api-access-rw25x\") pod \"payload-processing-5bf47cd988-p62qp\" (UID: \"ba91a689-60db-4bb1-b449-65df45c9d879\") " pod="openshift-ingress/payload-processing-5bf47cd988-p62qp"
Jul 21 16:37:07.022363 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:07.022225    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba91a689-60db-4bb1-b449-65df45c9d879-plugins-config-volume\") pod \"payload-processing-5bf47cd988-p62qp\" (UID: \"ba91a689-60db-4bb1-b449-65df45c9d879\") " pod="openshift-ingress/payload-processing-5bf47cd988-p62qp"
Jul 21 16:37:07.122800 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:07.122765    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba91a689-60db-4bb1-b449-65df45c9d879-plugins-config-volume\") pod \"payload-processing-5bf47cd988-p62qp\" (UID: \"ba91a689-60db-4bb1-b449-65df45c9d879\") " pod="openshift-ingress/payload-processing-5bf47cd988-p62qp"
Jul 21 16:37:07.122987 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:07.122896    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw25x\" (UniqueName: \"kubernetes.io/projected/ba91a689-60db-4bb1-b449-65df45c9d879-kube-api-access-rw25x\") pod \"payload-processing-5bf47cd988-p62qp\" (UID: \"ba91a689-60db-4bb1-b449-65df45c9d879\") " pod="openshift-ingress/payload-processing-5bf47cd988-p62qp"
Jul 21 16:37:07.123564 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:07.123500    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba91a689-60db-4bb1-b449-65df45c9d879-plugins-config-volume\") pod \"payload-processing-5bf47cd988-p62qp\" (UID: \"ba91a689-60db-4bb1-b449-65df45c9d879\") " pod="openshift-ingress/payload-processing-5bf47cd988-p62qp"
Jul 21 16:37:07.133412 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:07.133386    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw25x\" (UniqueName: \"kubernetes.io/projected/ba91a689-60db-4bb1-b449-65df45c9d879-kube-api-access-rw25x\") pod \"payload-processing-5bf47cd988-p62qp\" (UID: \"ba91a689-60db-4bb1-b449-65df45c9d879\") " pod="openshift-ingress/payload-processing-5bf47cd988-p62qp"
Jul 21 16:37:07.275912 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:07.275869    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-p62qp"
Jul 21 16:37:07.484821 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:07.484719    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-p62qp"]
Jul 21 16:37:07.936085 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:07.936051    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-p62qp" event={"ID":"ba91a689-60db-4bb1-b449-65df45c9d879","Type":"ContainerStarted","Data":"000fbb8a3dada651abd02e027321648ba7e139df6bdcd5e8a4c999fab9438366"}
Jul 21 16:37:09.949297 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:09.949255    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-p62qp" event={"ID":"ba91a689-60db-4bb1-b449-65df45c9d879","Type":"ContainerStarted","Data":"6d9440b4669b5e69eb997b905ff43756c0a94586e8e651b0355b3451b54f512a"}
Jul 21 16:37:09.949716 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:09.949349    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-p62qp"
Jul 21 16:37:09.967182 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:09.967121    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-p62qp" podStartSLOduration=2.072897713 podStartE2EDuration="3.967104417s" totalImagesPullingTime="1.894206704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:37:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:37:09.965416659 +0000 UTC m=+530.361647440" watchObservedRunningTime="2026-07-21 16:37:09.967104417 +0000 UTC m=+530.363335197"
Jul 21 16:37:14.980260 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:14.980221    2524 generic.go:356] "Generic (PLEG): container finished" podID="0390849d-de27-4991-81bc-3d3156217d98" containerID="7c7ab3382c195e0a32222c6ec1532c78462198974927f5d281005ddcd8a5bb69" exitCode=0
Jul 21 16:37:14.980751 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:14.980296    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg" event={"ID":"0390849d-de27-4991-81bc-3d3156217d98","Type":"ContainerDied","Data":"7c7ab3382c195e0a32222c6ec1532c78462198974927f5d281005ddcd8a5bb69"}
Jul 21 16:37:14.980751 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:14.980728    2524 scope.go:117] "RemoveContainer" containerID="7c7ab3382c195e0a32222c6ec1532c78462198974927f5d281005ddcd8a5bb69"
Jul 21 16:37:14.981799 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:14.981771    2524 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 21 16:37:14.981872 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:14.981846    2524 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 21 16:37:14.981908 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:14.981879    2524 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 21 16:37:15.988270 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:15.988230    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg" event={"ID":"0390849d-de27-4991-81bc-3d3156217d98","Type":"ContainerStarted","Data":"9f4e23dce8b4be0f9fc8de506c3ee300104485045a1363039703ce8bfc2f7ad9"}
Jul 21 16:37:16.047852 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:16.047808    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:37:16.049008 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:16.048980    2524 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hs8sg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 21 16:37:16.049157 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:16.049058    2524 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg" podUID="0390849d-de27-4991-81bc-3d3156217d98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 21 16:37:17.047256 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:17.047219    2524 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hs8sg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 21 16:37:17.047686 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:17.047275    2524 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg" podUID="0390849d-de27-4991-81bc-3d3156217d98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 21 16:37:18.047957 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:18.047916    2524 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hs8sg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 21 16:37:18.048357 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:18.047979    2524 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg" podUID="0390849d-de27-4991-81bc-3d3156217d98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 21 16:37:19.047697 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:19.047660    2524 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hs8sg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 21 16:37:19.047882 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:19.047721    2524 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg" podUID="0390849d-de27-4991-81bc-3d3156217d98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 21 16:37:19.413718 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:19.412767    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:37:20.048025 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:20.047991    2524 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hs8sg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 21 16:37:20.048174 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:20.048057    2524 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg" podUID="0390849d-de27-4991-81bc-3d3156217d98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 21 16:37:20.957209 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:20.957172    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-p62qp"
Jul 21 16:37:21.050819 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:21.050791    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:37:21.051767 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:21.051748    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hs8sg"
Jul 21 16:37:34.157938 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.157906    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"]
Jul 21 16:37:34.163380 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.163354    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.166389 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.166369    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 16:37:34.166530 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.166368    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 16:37:34.167541 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.167358    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fg4kl\""
Jul 21 16:37:34.167541 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.167387    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 21 16:37:34.178895 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.178873    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"]
Jul 21 16:37:34.287343 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.287302    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e35e5eaf-2d7d-4160-ac31-880bc4577d22-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.287343 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.287341    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e35e5eaf-2d7d-4160-ac31-880bc4577d22-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.287632 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.287449    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmk5c\" (UniqueName: \"kubernetes.io/projected/e35e5eaf-2d7d-4160-ac31-880bc4577d22-kube-api-access-kmk5c\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.287632 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.287543    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e35e5eaf-2d7d-4160-ac31-880bc4577d22-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.287632 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.287611    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e35e5eaf-2d7d-4160-ac31-880bc4577d22-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.287868 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.287648    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e35e5eaf-2d7d-4160-ac31-880bc4577d22-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.388261 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.388225    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e35e5eaf-2d7d-4160-ac31-880bc4577d22-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.388447 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.388293    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e35e5eaf-2d7d-4160-ac31-880bc4577d22-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.388447 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.388326    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e35e5eaf-2d7d-4160-ac31-880bc4577d22-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.388447 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.388378    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmk5c\" (UniqueName: \"kubernetes.io/projected/e35e5eaf-2d7d-4160-ac31-880bc4577d22-kube-api-access-kmk5c\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.388447 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.388440    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e35e5eaf-2d7d-4160-ac31-880bc4577d22-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.388683 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.388498    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e35e5eaf-2d7d-4160-ac31-880bc4577d22-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.388762 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.388744    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e35e5eaf-2d7d-4160-ac31-880bc4577d22-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.388849 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.388826    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e35e5eaf-2d7d-4160-ac31-880bc4577d22-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.388896 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.388827    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e35e5eaf-2d7d-4160-ac31-880bc4577d22-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.390877 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.390850    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e35e5eaf-2d7d-4160-ac31-880bc4577d22-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.391036 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.391019    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e35e5eaf-2d7d-4160-ac31-880bc4577d22-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.397620 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.397592    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmk5c\" (UniqueName: \"kubernetes.io/projected/e35e5eaf-2d7d-4160-ac31-880bc4577d22-kube-api-access-kmk5c\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8\" (UID: \"e35e5eaf-2d7d-4160-ac31-880bc4577d22\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.475559 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.475435    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:34.630039 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:34.629995    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"]
Jul 21 16:37:34.636498 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:37:34.636468    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35e5eaf_2d7d_4160_ac31_880bc4577d22.slice/crio-9e4059ba631b1c219336774ff4b45bd29ed3c76060a04b266cc4b8222299b831 WatchSource:0}: Error finding container 9e4059ba631b1c219336774ff4b45bd29ed3c76060a04b266cc4b8222299b831: Status 404 returned error can't find the container with id 9e4059ba631b1c219336774ff4b45bd29ed3c76060a04b266cc4b8222299b831
Jul 21 16:37:35.116253 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:35.116200    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8" event={"ID":"e35e5eaf-2d7d-4160-ac31-880bc4577d22","Type":"ContainerStarted","Data":"9e4059ba631b1c219336774ff4b45bd29ed3c76060a04b266cc4b8222299b831"}
Jul 21 16:37:36.123830 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:36.123743    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8" event={"ID":"e35e5eaf-2d7d-4160-ac31-880bc4577d22","Type":"ContainerStarted","Data":"b1f71557bba16711bcc82776f312e05435fe7a44e012cc8bdd2fa47af6c14450"}
Jul 21 16:37:36.144095 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:36.144033    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8" podStartSLOduration=0.910534358 podStartE2EDuration="2.144014511s" totalImagesPullingTime="1.233480153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:37:36.141215463 +0000 UTC m=+556.537446244" watchObservedRunningTime="2026-07-21 16:37:36.144014511 +0000 UTC m=+556.540245292"
Jul 21 16:37:44.476226 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:44.476191    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:44.476737 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:44.476255    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:44.488824 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:44.488802    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:45.186202 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:45.186167    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8"
Jul 21 16:37:46.956530 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:46.956481    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"]
Jul 21 16:37:46.960661 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:46.960638    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:46.963276 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:46.963255    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 21 16:37:46.977679 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:46.977659    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"]
Jul 21 16:37:47.122088 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.122054    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2769332-de23-4911-9506-c2e15b590204-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.122270 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.122096    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2769332-de23-4911-9506-c2e15b590204-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.122270 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.122137    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpztv\" (UniqueName: \"kubernetes.io/projected/b2769332-de23-4911-9506-c2e15b590204-kube-api-access-cpztv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.122270 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.122197    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2769332-de23-4911-9506-c2e15b590204-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.122270 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.122260    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2769332-de23-4911-9506-c2e15b590204-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.122431 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.122347    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2769332-de23-4911-9506-c2e15b590204-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.223924 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.223811    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2769332-de23-4911-9506-c2e15b590204-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.223924 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.223874    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2769332-de23-4911-9506-c2e15b590204-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.223924 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.223917    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpztv\" (UniqueName: \"kubernetes.io/projected/b2769332-de23-4911-9506-c2e15b590204-kube-api-access-cpztv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.224201 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.224000    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2769332-de23-4911-9506-c2e15b590204-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.224201 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.224033    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2769332-de23-4911-9506-c2e15b590204-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.224201 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.224126    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2769332-de23-4911-9506-c2e15b590204-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.224594 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.224552    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2769332-de23-4911-9506-c2e15b590204-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.224814 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.224786    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2769332-de23-4911-9506-c2e15b590204-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.225342 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.225314    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2769332-de23-4911-9506-c2e15b590204-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.226975 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.226953    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2769332-de23-4911-9506-c2e15b590204-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.227864 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.227846    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2769332-de23-4911-9506-c2e15b590204-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.233394 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.233373    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpztv\" (UniqueName: \"kubernetes.io/projected/b2769332-de23-4911-9506-c2e15b590204-kube-api-access-cpztv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-8zhhn\" (UID: \"b2769332-de23-4911-9506-c2e15b590204\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.273187 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.273167    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:47.415368 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:47.415340    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"]
Jul 21 16:37:47.416790 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:37:47.416764    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2769332_de23_4911_9506_c2e15b590204.slice/crio-2f356b4ca3c4c5df7e4d5a17be5d6af3ec92dda8f1e6d121ff91c1a898bdda2c WatchSource:0}: Error finding container 2f356b4ca3c4c5df7e4d5a17be5d6af3ec92dda8f1e6d121ff91c1a898bdda2c: Status 404 returned error can't find the container with id 2f356b4ca3c4c5df7e4d5a17be5d6af3ec92dda8f1e6d121ff91c1a898bdda2c
Jul 21 16:37:48.196820 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:48.196772    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn" event={"ID":"b2769332-de23-4911-9506-c2e15b590204","Type":"ContainerStarted","Data":"65714eb2916ec410e1d2cbf3fcff263d24c251a868b1190a3ddfc0b4ff1c3ff8"}
Jul 21 16:37:48.197281 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:48.196847    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn" event={"ID":"b2769332-de23-4911-9506-c2e15b590204","Type":"ContainerStarted","Data":"2f356b4ca3c4c5df7e4d5a17be5d6af3ec92dda8f1e6d121ff91c1a898bdda2c"}
Jul 21 16:37:48.217315 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:48.217257    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn" podStartSLOduration=2.029668611 podStartE2EDuration="2.217237029s" totalImagesPullingTime="187.568418ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:37:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:37:48.216174388 +0000 UTC m=+568.612405191" watchObservedRunningTime="2026-07-21 16:37:48.217237029 +0000 UTC m=+568.613467811"
Jul 21 16:37:57.274108 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:57.274071    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:57.274576 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:57.274146    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:57.287681 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:57.287619    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:37:58.264397 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:37:58.264366    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-8zhhn"
Jul 21 16:38:07.273442 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.273398    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"]
Jul 21 16:38:07.277423 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.277401    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.280494 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.280473    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 21 16:38:07.290097 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.290070    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"]
Jul 21 16:38:07.401679 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.401645    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6pl6\" (UniqueName: \"kubernetes.io/projected/c125759c-1533-42b1-9e25-c321f83098b9-kube-api-access-b6pl6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.401859 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.401693    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c125759c-1533-42b1-9e25-c321f83098b9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.401859 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.401721    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c125759c-1533-42b1-9e25-c321f83098b9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.401859 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.401764    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c125759c-1533-42b1-9e25-c321f83098b9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.401859 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.401806    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c125759c-1533-42b1-9e25-c321f83098b9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.401859 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.401848    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c125759c-1533-42b1-9e25-c321f83098b9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.502795 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.502761    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c125759c-1533-42b1-9e25-c321f83098b9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.502795 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.502804    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c125759c-1533-42b1-9e25-c321f83098b9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.503061 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.502910    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6pl6\" (UniqueName: \"kubernetes.io/projected/c125759c-1533-42b1-9e25-c321f83098b9-kube-api-access-b6pl6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.503061 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.502952    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c125759c-1533-42b1-9e25-c321f83098b9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.503061 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.502987    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c125759c-1533-42b1-9e25-c321f83098b9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.503061 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.503018    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c125759c-1533-42b1-9e25-c321f83098b9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.503769 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.503715    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c125759c-1533-42b1-9e25-c321f83098b9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.503769 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.503752    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c125759c-1533-42b1-9e25-c321f83098b9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.503963 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.503779    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c125759c-1533-42b1-9e25-c321f83098b9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.506020 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.505995    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c125759c-1533-42b1-9e25-c321f83098b9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.506244 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.506223    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c125759c-1533-42b1-9e25-c321f83098b9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.515115 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.515089    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6pl6\" (UniqueName: \"kubernetes.io/projected/c125759c-1533-42b1-9e25-c321f83098b9-kube-api-access-b6pl6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4ggs7\" (UID: \"c125759c-1533-42b1-9e25-c321f83098b9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.591652 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.591591    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:07.733640 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:07.733613    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"]
Jul 21 16:38:07.734254 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:38:07.734223    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc125759c_1533_42b1_9e25_c321f83098b9.slice/crio-ae201c752687b9fbfcec29d849faf5c60954aace03eec1eac2199b8c1e35c586 WatchSource:0}: Error finding container ae201c752687b9fbfcec29d849faf5c60954aace03eec1eac2199b8c1e35c586: Status 404 returned error can't find the container with id ae201c752687b9fbfcec29d849faf5c60954aace03eec1eac2199b8c1e35c586
Jul 21 16:38:08.314330 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:08.314295    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7" event={"ID":"c125759c-1533-42b1-9e25-c321f83098b9","Type":"ContainerStarted","Data":"c17f957b2bc51d6508026144de31a55f149d17c9e85c8254e96f05d94a1e09e7"}
Jul 21 16:38:08.314801 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:08.314351    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7" event={"ID":"c125759c-1533-42b1-9e25-c321f83098b9","Type":"ContainerStarted","Data":"ae201c752687b9fbfcec29d849faf5c60954aace03eec1eac2199b8c1e35c586"}
Jul 21 16:38:08.335681 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:08.335637    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7" podStartSLOduration=1.12083516 podStartE2EDuration="1.335621616s" totalImagesPullingTime="214.786456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:38:08.333152399 +0000 UTC m=+588.729383193" watchObservedRunningTime="2026-07-21 16:38:08.335621616 +0000 UTC m=+588.731852396"
Jul 21 16:38:17.592355 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:17.592320    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:17.592837 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:17.592382    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:17.605491 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:17.605457    2524 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:38:18.394278 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:38:18.394251    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4ggs7"
Jul 21 16:39:19.876629 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:19.876592    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57cd47b448-gxmgs"]
Jul 21 16:39:19.880180 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:19.880165    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57cd47b448-gxmgs"
Jul 21 16:39:19.887762 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:19.887741    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57cd47b448-gxmgs"]
Jul 21 16:39:20.020649 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:20.020624    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gzwh\" (UniqueName: \"kubernetes.io/projected/57825062-7dc0-4d85-afe5-831df64f0283-kube-api-access-2gzwh\") pod \"authorino-57cd47b448-gxmgs\" (UID: \"57825062-7dc0-4d85-afe5-831df64f0283\") " pod="kuadrant-system/authorino-57cd47b448-gxmgs"
Jul 21 16:39:20.020778 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:20.020686    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57825062-7dc0-4d85-afe5-831df64f0283-tls-cert\") pod \"authorino-57cd47b448-gxmgs\" (UID: \"57825062-7dc0-4d85-afe5-831df64f0283\") " pod="kuadrant-system/authorino-57cd47b448-gxmgs"
Jul 21 16:39:20.121351 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:20.121325    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gzwh\" (UniqueName: \"kubernetes.io/projected/57825062-7dc0-4d85-afe5-831df64f0283-kube-api-access-2gzwh\") pod \"authorino-57cd47b448-gxmgs\" (UID: \"57825062-7dc0-4d85-afe5-831df64f0283\") " pod="kuadrant-system/authorino-57cd47b448-gxmgs"
Jul 21 16:39:20.121484 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:20.121386    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57825062-7dc0-4d85-afe5-831df64f0283-tls-cert\") pod \"authorino-57cd47b448-gxmgs\" (UID: \"57825062-7dc0-4d85-afe5-831df64f0283\") " pod="kuadrant-system/authorino-57cd47b448-gxmgs"
Jul 21 16:39:20.123698 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:20.123680    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57825062-7dc0-4d85-afe5-831df64f0283-tls-cert\") pod \"authorino-57cd47b448-gxmgs\" (UID: \"57825062-7dc0-4d85-afe5-831df64f0283\") " pod="kuadrant-system/authorino-57cd47b448-gxmgs"
Jul 21 16:39:20.130690 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:20.130630    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gzwh\" (UniqueName: \"kubernetes.io/projected/57825062-7dc0-4d85-afe5-831df64f0283-kube-api-access-2gzwh\") pod \"authorino-57cd47b448-gxmgs\" (UID: \"57825062-7dc0-4d85-afe5-831df64f0283\") " pod="kuadrant-system/authorino-57cd47b448-gxmgs"
Jul 21 16:39:20.190285 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:20.190262    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57cd47b448-gxmgs"
Jul 21 16:39:20.338271 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:20.338241    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57cd47b448-gxmgs"]
Jul 21 16:39:20.338499 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:39:20.338470    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57825062_7dc0_4d85_afe5_831df64f0283.slice/crio-74c3e84ee646e833b2cceb644ac747767b800d6ebb16db8a7e796f9bf2ce0317 WatchSource:0}: Error finding container 74c3e84ee646e833b2cceb644ac747767b800d6ebb16db8a7e796f9bf2ce0317: Status 404 returned error can't find the container with id 74c3e84ee646e833b2cceb644ac747767b800d6ebb16db8a7e796f9bf2ce0317
Jul 21 16:39:20.339929 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:20.339907    2524 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:39:20.740118 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:20.740086    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57cd47b448-gxmgs" event={"ID":"57825062-7dc0-4d85-afe5-831df64f0283","Type":"ContainerStarted","Data":"74c3e84ee646e833b2cceb644ac747767b800d6ebb16db8a7e796f9bf2ce0317"}
Jul 21 16:39:21.747575 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:21.747540    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57cd47b448-gxmgs" event={"ID":"57825062-7dc0-4d85-afe5-831df64f0283","Type":"ContainerStarted","Data":"2546d1c2e9a2fd21af51d120cbf2fe9787e872179056cd37be03caf28b8163fc"}
Jul 21 16:39:21.803008 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:21.802938    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57cd47b448-gxmgs" podStartSLOduration=2.136993512 podStartE2EDuration="2.802917269s" totalImagesPullingTime="665.923757ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:39:21.797293421 +0000 UTC m=+662.193524201" watchObservedRunningTime="2026-07-21 16:39:21.802917269 +0000 UTC m=+662.199148049"
Jul 21 16:39:21.910532 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:21.906593    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-dcd5b4545-zrdtf"]
Jul 21 16:39:21.910532 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:21.906861    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-dcd5b4545-zrdtf" podUID="93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4" containerName="authorino" containerID="cri-o://f2dbca5b7d7bedd7fbba37d627185b2a3daa4b25ddfeb2428416dd8ba991e8ba" gracePeriod=30
Jul 21 16:39:22.178362 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.178337    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dcd5b4545-zrdtf"
Jul 21 16:39:22.345052 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.344964    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4-tls-cert\") pod \"93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4\" (UID: \"93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4\") "
Jul 21 16:39:22.345052 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.345023    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m92x\" (UniqueName: \"kubernetes.io/projected/93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4-kube-api-access-6m92x\") pod \"93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4\" (UID: \"93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4\") "
Jul 21 16:39:22.347173 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.347138    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4-kube-api-access-6m92x" (OuterVolumeSpecName: "kube-api-access-6m92x") pod "93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4" (UID: "93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4"). InnerVolumeSpecName "kube-api-access-6m92x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:39:22.356138 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.356108    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4" (UID: "93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:39:22.446068 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.446038    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m92x\" (UniqueName: \"kubernetes.io/projected/93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4-kube-api-access-6m92x\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:39:22.446068 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.446068    2524 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4-tls-cert\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:39:22.756343 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.756258    2524 generic.go:356] "Generic (PLEG): container finished" podID="93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4" containerID="f2dbca5b7d7bedd7fbba37d627185b2a3daa4b25ddfeb2428416dd8ba991e8ba" exitCode=0
Jul 21 16:39:22.756891 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.756318    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dcd5b4545-zrdtf"
Jul 21 16:39:22.757560 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.756341    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dcd5b4545-zrdtf" event={"ID":"93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4","Type":"ContainerDied","Data":"f2dbca5b7d7bedd7fbba37d627185b2a3daa4b25ddfeb2428416dd8ba991e8ba"}
Jul 21 16:39:22.757741 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.757724    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dcd5b4545-zrdtf" event={"ID":"93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4","Type":"ContainerDied","Data":"ba2b79264818cab63dd4d936e9a36d36f1f1051b2c1e407cfcd040e436f83099"}
Jul 21 16:39:22.757840 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.757828    2524 scope.go:117] "RemoveContainer" containerID="f2dbca5b7d7bedd7fbba37d627185b2a3daa4b25ddfeb2428416dd8ba991e8ba"
Jul 21 16:39:22.779453 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.777599    2524 scope.go:117] "RemoveContainer" containerID="f2dbca5b7d7bedd7fbba37d627185b2a3daa4b25ddfeb2428416dd8ba991e8ba"
Jul 21 16:39:22.779453 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:39:22.777953    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2dbca5b7d7bedd7fbba37d627185b2a3daa4b25ddfeb2428416dd8ba991e8ba\": container with ID starting with f2dbca5b7d7bedd7fbba37d627185b2a3daa4b25ddfeb2428416dd8ba991e8ba not found: ID does not exist" containerID="f2dbca5b7d7bedd7fbba37d627185b2a3daa4b25ddfeb2428416dd8ba991e8ba"
Jul 21 16:39:22.779453 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.778002    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2dbca5b7d7bedd7fbba37d627185b2a3daa4b25ddfeb2428416dd8ba991e8ba"} err="failed to get container status \"f2dbca5b7d7bedd7fbba37d627185b2a3daa4b25ddfeb2428416dd8ba991e8ba\": rpc error: code = NotFound desc = could not find container \"f2dbca5b7d7bedd7fbba37d627185b2a3daa4b25ddfeb2428416dd8ba991e8ba\": container with ID starting with f2dbca5b7d7bedd7fbba37d627185b2a3daa4b25ddfeb2428416dd8ba991e8ba not found: ID does not exist"
Jul 21 16:39:22.787588 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.787562    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-dcd5b4545-zrdtf"]
Jul 21 16:39:22.792199 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:22.792174    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-dcd5b4545-zrdtf"]
Jul 21 16:39:24.061264 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:39:24.061232    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4" path="/var/lib/kubelet/pods/93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4/volumes"
Jul 21 16:40:10.101563 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:10.101535    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57669fdb4c-hz2wz"]
Jul 21 16:40:10.102014 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:10.101783    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-57669fdb4c-hz2wz" podUID="671cfafd-e6ea-4e6f-8a7a-c467ee83ad74" containerName="manager" containerID="cri-o://902996908bc1311b22150a11c4d0faa86c064b246e1b251133283e6d3b5a9340" gracePeriod=30
Jul 21 16:40:10.355276 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:10.355222    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57669fdb4c-hz2wz"
Jul 21 16:40:10.467224 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:10.467195    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/671cfafd-e6ea-4e6f-8a7a-c467ee83ad74-webhook-cert\") pod \"671cfafd-e6ea-4e6f-8a7a-c467ee83ad74\" (UID: \"671cfafd-e6ea-4e6f-8a7a-c467ee83ad74\") "
Jul 21 16:40:10.467385 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:10.467239    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr9b5\" (UniqueName: \"kubernetes.io/projected/671cfafd-e6ea-4e6f-8a7a-c467ee83ad74-kube-api-access-mr9b5\") pod \"671cfafd-e6ea-4e6f-8a7a-c467ee83ad74\" (UID: \"671cfafd-e6ea-4e6f-8a7a-c467ee83ad74\") "
Jul 21 16:40:10.469648 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:10.469612    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/671cfafd-e6ea-4e6f-8a7a-c467ee83ad74-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "671cfafd-e6ea-4e6f-8a7a-c467ee83ad74" (UID: "671cfafd-e6ea-4e6f-8a7a-c467ee83ad74"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:40:10.469776 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:10.469725    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/671cfafd-e6ea-4e6f-8a7a-c467ee83ad74-kube-api-access-mr9b5" (OuterVolumeSpecName: "kube-api-access-mr9b5") pod "671cfafd-e6ea-4e6f-8a7a-c467ee83ad74" (UID: "671cfafd-e6ea-4e6f-8a7a-c467ee83ad74"). InnerVolumeSpecName "kube-api-access-mr9b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:40:10.568424 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:10.568394    2524 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/671cfafd-e6ea-4e6f-8a7a-c467ee83ad74-webhook-cert\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:40:10.568424 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:10.568421    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr9b5\" (UniqueName: \"kubernetes.io/projected/671cfafd-e6ea-4e6f-8a7a-c467ee83ad74-kube-api-access-mr9b5\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:40:11.036176 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:11.036143    2524 generic.go:356] "Generic (PLEG): container finished" podID="671cfafd-e6ea-4e6f-8a7a-c467ee83ad74" containerID="902996908bc1311b22150a11c4d0faa86c064b246e1b251133283e6d3b5a9340" exitCode=0
Jul 21 16:40:11.036344 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:11.036218    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57669fdb4c-hz2wz"
Jul 21 16:40:11.036344 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:11.036231    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57669fdb4c-hz2wz" event={"ID":"671cfafd-e6ea-4e6f-8a7a-c467ee83ad74","Type":"ContainerDied","Data":"902996908bc1311b22150a11c4d0faa86c064b246e1b251133283e6d3b5a9340"}
Jul 21 16:40:11.036344 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:11.036306    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57669fdb4c-hz2wz" event={"ID":"671cfafd-e6ea-4e6f-8a7a-c467ee83ad74","Type":"ContainerDied","Data":"7f3868cb80e8294f97f44d195051e6009b062bdaaa12bc604d4b90a97775e6cb"}
Jul 21 16:40:11.036344 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:11.036329    2524 scope.go:117] "RemoveContainer" containerID="902996908bc1311b22150a11c4d0faa86c064b246e1b251133283e6d3b5a9340"
Jul 21 16:40:11.045694 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:11.045678    2524 scope.go:117] "RemoveContainer" containerID="902996908bc1311b22150a11c4d0faa86c064b246e1b251133283e6d3b5a9340"
Jul 21 16:40:11.045945 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:40:11.045928    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"902996908bc1311b22150a11c4d0faa86c064b246e1b251133283e6d3b5a9340\": container with ID starting with 902996908bc1311b22150a11c4d0faa86c064b246e1b251133283e6d3b5a9340 not found: ID does not exist" containerID="902996908bc1311b22150a11c4d0faa86c064b246e1b251133283e6d3b5a9340"
Jul 21 16:40:11.045989 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:11.045953    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"902996908bc1311b22150a11c4d0faa86c064b246e1b251133283e6d3b5a9340"} err="failed to get container status \"902996908bc1311b22150a11c4d0faa86c064b246e1b251133283e6d3b5a9340\": rpc error: code = NotFound desc = could not find container \"902996908bc1311b22150a11c4d0faa86c064b246e1b251133283e6d3b5a9340\": container with ID starting with 902996908bc1311b22150a11c4d0faa86c064b246e1b251133283e6d3b5a9340 not found: ID does not exist"
Jul 21 16:40:11.060633 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:11.060603    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57669fdb4c-hz2wz"]
Jul 21 16:40:11.065556 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:11.065535    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57669fdb4c-hz2wz"]
Jul 21 16:40:12.060017 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:40:12.059986    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="671cfafd-e6ea-4e6f-8a7a-c467ee83ad74" path="/var/lib/kubelet/pods/671cfafd-e6ea-4e6f-8a7a-c467ee83ad74/volumes"
Jul 21 16:46:14.136803 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:14.136718    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"]
Jul 21 16:46:14.137526 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:14.137002    2524 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l" podUID="c6aac9d0-5e77-4c04-90c7-539e8279ac7c" containerName="manager" containerID="cri-o://4d8c8a55abbab15e39b98911392805ccd2df33359c37bc8ab595bb172af7f46d" gracePeriod=10
Jul 21 16:46:17.396964 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:17.396939    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"
Jul 21 16:46:17.585344 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:17.585308    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6aac9d0-5e77-4c04-90c7-539e8279ac7c-extensions-socket-volume\") pod \"c6aac9d0-5e77-4c04-90c7-539e8279ac7c\" (UID: \"c6aac9d0-5e77-4c04-90c7-539e8279ac7c\") "
Jul 21 16:46:17.585565 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:17.585384    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh9cs\" (UniqueName: \"kubernetes.io/projected/c6aac9d0-5e77-4c04-90c7-539e8279ac7c-kube-api-access-sh9cs\") pod \"c6aac9d0-5e77-4c04-90c7-539e8279ac7c\" (UID: \"c6aac9d0-5e77-4c04-90c7-539e8279ac7c\") "
Jul 21 16:46:17.585782 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:17.585758    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6aac9d0-5e77-4c04-90c7-539e8279ac7c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c6aac9d0-5e77-4c04-90c7-539e8279ac7c" (UID: "c6aac9d0-5e77-4c04-90c7-539e8279ac7c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:46:17.587678 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:17.587652    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6aac9d0-5e77-4c04-90c7-539e8279ac7c-kube-api-access-sh9cs" (OuterVolumeSpecName: "kube-api-access-sh9cs") pod "c6aac9d0-5e77-4c04-90c7-539e8279ac7c" (UID: "c6aac9d0-5e77-4c04-90c7-539e8279ac7c"). InnerVolumeSpecName "kube-api-access-sh9cs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:46:17.686753 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:17.686725    2524 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6aac9d0-5e77-4c04-90c7-539e8279ac7c-extensions-socket-volume\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:46:17.686753 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:17.686750    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh9cs\" (UniqueName: \"kubernetes.io/projected/c6aac9d0-5e77-4c04-90c7-539e8279ac7c-kube-api-access-sh9cs\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 16:46:18.143122 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:18.143087    2524 generic.go:356] "Generic (PLEG): container finished" podID="c6aac9d0-5e77-4c04-90c7-539e8279ac7c" containerID="4d8c8a55abbab15e39b98911392805ccd2df33359c37bc8ab595bb172af7f46d" exitCode=0
Jul 21 16:46:18.143301 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:18.143132    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"
Jul 21 16:46:18.143301 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:18.143146    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l" event={"ID":"c6aac9d0-5e77-4c04-90c7-539e8279ac7c","Type":"ContainerDied","Data":"4d8c8a55abbab15e39b98911392805ccd2df33359c37bc8ab595bb172af7f46d"}
Jul 21 16:46:18.143301 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:18.143203    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l" event={"ID":"c6aac9d0-5e77-4c04-90c7-539e8279ac7c","Type":"ContainerDied","Data":"331bdb1e680b596792cb82231fba804ec0da0377c456a395bc696c5fa6cc5494"}
Jul 21 16:46:18.143301 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:18.143232    2524 scope.go:117] "RemoveContainer" containerID="4d8c8a55abbab15e39b98911392805ccd2df33359c37bc8ab595bb172af7f46d"
Jul 21 16:46:18.153808 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:18.153789    2524 scope.go:117] "RemoveContainer" containerID="4d8c8a55abbab15e39b98911392805ccd2df33359c37bc8ab595bb172af7f46d"
Jul 21 16:46:18.154064 ip-10-0-135-103 kubenswrapper[2524]: E0721 16:46:18.154047    2524 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d8c8a55abbab15e39b98911392805ccd2df33359c37bc8ab595bb172af7f46d\": container with ID starting with 4d8c8a55abbab15e39b98911392805ccd2df33359c37bc8ab595bb172af7f46d not found: ID does not exist" containerID="4d8c8a55abbab15e39b98911392805ccd2df33359c37bc8ab595bb172af7f46d"
Jul 21 16:46:18.154109 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:18.154071    2524 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8c8a55abbab15e39b98911392805ccd2df33359c37bc8ab595bb172af7f46d"} err="failed to get container status \"4d8c8a55abbab15e39b98911392805ccd2df33359c37bc8ab595bb172af7f46d\": rpc error: code = NotFound desc = could not find container \"4d8c8a55abbab15e39b98911392805ccd2df33359c37bc8ab595bb172af7f46d\": container with ID starting with 4d8c8a55abbab15e39b98911392805ccd2df33359c37bc8ab595bb172af7f46d not found: ID does not exist"
Jul 21 16:46:18.168404 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:18.168382    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"]
Jul 21 16:46:18.172174 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:18.172149    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xlm5l"]
Jul 21 16:46:20.061170 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:46:20.061141    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6aac9d0-5e77-4c04-90c7-539e8279ac7c" path="/var/lib/kubelet/pods/c6aac9d0-5e77-4c04-90c7-539e8279ac7c/volumes"
Jul 21 16:47:15.251772 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.251736    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng"]
Jul 21 16:47:15.252251 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.252204    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6aac9d0-5e77-4c04-90c7-539e8279ac7c" containerName="manager"
Jul 21 16:47:15.252251 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.252218    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6aac9d0-5e77-4c04-90c7-539e8279ac7c" containerName="manager"
Jul 21 16:47:15.252251 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.252238    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="671cfafd-e6ea-4e6f-8a7a-c467ee83ad74" containerName="manager"
Jul 21 16:47:15.252251 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.252244    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="671cfafd-e6ea-4e6f-8a7a-c467ee83ad74" containerName="manager"
Jul 21 16:47:15.252251 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.252250    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4" containerName="authorino"
Jul 21 16:47:15.252456 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.252257    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4" containerName="authorino"
Jul 21 16:47:15.252456 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.252328    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="671cfafd-e6ea-4e6f-8a7a-c467ee83ad74" containerName="manager"
Jul 21 16:47:15.252456 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.252340    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="93e4d86d-ecfb-4e4c-aa6e-bdd6dd7512a4" containerName="authorino"
Jul 21 16:47:15.252456 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.252346    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6aac9d0-5e77-4c04-90c7-539e8279ac7c" containerName="manager"
Jul 21 16:47:15.255523 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.255493    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng"
Jul 21 16:47:15.258288 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.258264    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dcmnb\""
Jul 21 16:47:15.269462 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.269437    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng"]
Jul 21 16:47:15.296330 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.296298    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9xcj\" (UniqueName: \"kubernetes.io/projected/737e44fe-5552-4156-86ad-9f33328e4855-kube-api-access-v9xcj\") pod \"kuadrant-operator-controller-manager-86878c769f-rchng\" (UID: \"737e44fe-5552-4156-86ad-9f33328e4855\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng"
Jul 21 16:47:15.296453 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.296393    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/737e44fe-5552-4156-86ad-9f33328e4855-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rchng\" (UID: \"737e44fe-5552-4156-86ad-9f33328e4855\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng"
Jul 21 16:47:15.397196 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.397160    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9xcj\" (UniqueName: \"kubernetes.io/projected/737e44fe-5552-4156-86ad-9f33328e4855-kube-api-access-v9xcj\") pod \"kuadrant-operator-controller-manager-86878c769f-rchng\" (UID: \"737e44fe-5552-4156-86ad-9f33328e4855\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng"
Jul 21 16:47:15.397342 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.397235    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/737e44fe-5552-4156-86ad-9f33328e4855-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rchng\" (UID: \"737e44fe-5552-4156-86ad-9f33328e4855\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng"
Jul 21 16:47:15.397623 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.397605    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/737e44fe-5552-4156-86ad-9f33328e4855-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rchng\" (UID: \"737e44fe-5552-4156-86ad-9f33328e4855\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng"
Jul 21 16:47:15.406708 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.406688    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9xcj\" (UniqueName: \"kubernetes.io/projected/737e44fe-5552-4156-86ad-9f33328e4855-kube-api-access-v9xcj\") pod \"kuadrant-operator-controller-manager-86878c769f-rchng\" (UID: \"737e44fe-5552-4156-86ad-9f33328e4855\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng"
Jul 21 16:47:15.565388 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.565352    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng"
Jul 21 16:47:15.724463 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:15.724440    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng"]
Jul 21 16:47:15.726554 ip-10-0-135-103 kubenswrapper[2524]: W0721 16:47:15.726523    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod737e44fe_5552_4156_86ad_9f33328e4855.slice/crio-2ca46edff6cafedfa4a937041280573d02781e28fc63428aa39eb433ab613c98 WatchSource:0}: Error finding container 2ca46edff6cafedfa4a937041280573d02781e28fc63428aa39eb433ab613c98: Status 404 returned error can't find the container with id 2ca46edff6cafedfa4a937041280573d02781e28fc63428aa39eb433ab613c98
Jul 21 16:47:16.507501 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:16.507465    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng" event={"ID":"737e44fe-5552-4156-86ad-9f33328e4855","Type":"ContainerStarted","Data":"29161f7c6fed99623052092c8bac26c2f2b601de4e4219ca336f798e2ac4ecdb"}
Jul 21 16:47:16.507959 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:16.507559    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng" event={"ID":"737e44fe-5552-4156-86ad-9f33328e4855","Type":"ContainerStarted","Data":"2ca46edff6cafedfa4a937041280573d02781e28fc63428aa39eb433ab613c98"}
Jul 21 16:47:16.507959 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:16.507689    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng"
Jul 21 16:47:16.541073 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:16.541022    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng" podStartSLOduration=1.541009285 podStartE2EDuration="1.541009285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:47:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:47:16.540928927 +0000 UTC m=+1136.937159709" watchObservedRunningTime="2026-07-21 16:47:16.541009285 +0000 UTC m=+1136.937240066"
Jul 21 16:47:27.517087 ip-10-0-135-103 kubenswrapper[2524]: I0721 16:47:27.517045    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rchng"
Jul 21 17:05:15.657440 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:15.657409    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb"]
Jul 21 17:05:15.661123 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:15.661105    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb"
Jul 21 17:05:15.664649 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:15.664626    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5fqhm\""
Jul 21 17:05:15.670440 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:15.670415    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb"]
Jul 21 17:05:15.781929 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:15.781887    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33c80cc9-8241-4184-a841-fe0cac62358f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb\" (UID: \"33c80cc9-8241-4184-a841-fe0cac62358f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb"
Jul 21 17:05:15.882741 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:15.882705    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33c80cc9-8241-4184-a841-fe0cac62358f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb\" (UID: \"33c80cc9-8241-4184-a841-fe0cac62358f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb"
Jul 21 17:05:15.883308 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:15.883288    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33c80cc9-8241-4184-a841-fe0cac62358f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb\" (UID: \"33c80cc9-8241-4184-a841-fe0cac62358f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb"
Jul 21 17:05:15.973200 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:15.973113    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb"
Jul 21 17:05:16.115250 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:16.115221    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb"]
Jul 21 17:05:16.116876 ip-10-0-135-103 kubenswrapper[2524]: W0721 17:05:16.116853    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c80cc9_8241_4184_a841_fe0cac62358f.slice/crio-041828913f76a408d6bac938d080465e045d414e675e40863bf032be5f32f2ec WatchSource:0}: Error finding container 041828913f76a408d6bac938d080465e045d414e675e40863bf032be5f32f2ec: Status 404 returned error can't find the container with id 041828913f76a408d6bac938d080465e045d414e675e40863bf032be5f32f2ec
Jul 21 17:05:16.118854 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:16.118838    2524 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:05:16.906962 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:16.906924    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb" event={"ID":"33c80cc9-8241-4184-a841-fe0cac62358f","Type":"ContainerStarted","Data":"041828913f76a408d6bac938d080465e045d414e675e40863bf032be5f32f2ec"}
Jul 21 17:05:19.934929 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:19.934883    2524 generic.go:356] "Generic (PLEG): container finished" podID="33c80cc9-8241-4184-a841-fe0cac62358f" containerID="e594614206e6eb888dbf4e6ce6f029c599d7eb3e0ba418c4dc826bf5e34aa786" exitCode=0
Jul 21 17:05:19.935319 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:19.934945    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb" event={"ID":"33c80cc9-8241-4184-a841-fe0cac62358f","Type":"ContainerDied","Data":"e594614206e6eb888dbf4e6ce6f029c599d7eb3e0ba418c4dc826bf5e34aa786"}
Jul 21 17:05:21.076691 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:21.076663    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb"
Jul 21 17:05:21.239886 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:21.239785    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33c80cc9-8241-4184-a841-fe0cac62358f-maas-api-service-ca\") pod \"33c80cc9-8241-4184-a841-fe0cac62358f\" (UID: \"33c80cc9-8241-4184-a841-fe0cac62358f\") "
Jul 21 17:05:21.240146 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:21.240124    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33c80cc9-8241-4184-a841-fe0cac62358f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "33c80cc9-8241-4184-a841-fe0cac62358f" (UID: "33c80cc9-8241-4184-a841-fe0cac62358f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:05:21.341110 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:21.341075    2524 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33c80cc9-8241-4184-a841-fe0cac62358f-maas-api-service-ca\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 17:05:21.948857 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:21.948829    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb"
Jul 21 17:05:21.949017 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:21.948854    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb" event={"ID":"33c80cc9-8241-4184-a841-fe0cac62358f","Type":"ContainerDied","Data":"041828913f76a408d6bac938d080465e045d414e675e40863bf032be5f32f2ec"}
Jul 21 17:05:21.949017 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:21.948900    2524 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="041828913f76a408d6bac938d080465e045d414e675e40863bf032be5f32f2ec"
Jul 21 17:05:30.806351 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:30.806312    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb"]
Jul 21 17:05:30.809865 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:30.809841    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-981b1e-7t2hb"]
Jul 21 17:05:32.061092 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:05:32.061058    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33c80cc9-8241-4184-a841-fe0cac62358f" path="/var/lib/kubelet/pods/33c80cc9-8241-4184-a841-fe0cac62358f/volumes"
Jul 21 17:11:20.333301 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:11:20.333254    2524 scope.go:117] "RemoveContainer" containerID="e594614206e6eb888dbf4e6ce6f029c599d7eb3e0ba418c4dc826bf5e34aa786"
Jul 21 17:13:47.813218 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:47.813188    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-139965123660592"]
Jul 21 17:13:47.813702 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:47.813648    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33c80cc9-8241-4184-a841-fe0cac62358f" containerName="revoke-keys"
Jul 21 17:13:47.813702 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:47.813662    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="33c80cc9-8241-4184-a841-fe0cac62358f" containerName="revoke-keys"
Jul 21 17:13:47.813783 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:47.813731    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="33c80cc9-8241-4184-a841-fe0cac62358f" containerName="revoke-keys"
Jul 21 17:13:47.816838 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:47.816822    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123660592"
Jul 21 17:13:47.819218 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:47.819203    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-w8qh4\""
Jul 21 17:13:47.824721 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:47.824392    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139965123660592"]
Jul 21 17:13:47.894405 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:47.894383    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsdh6\" (UniqueName: \"kubernetes.io/projected/3fc33bb0-8b93-4ccf-b410-a1de965a6464-kube-api-access-lsdh6\") pod \"test-curl-7497-139965123660592\" (UID: \"3fc33bb0-8b93-4ccf-b410-a1de965a6464\") " pod="opendatahub/test-curl-7497-139965123660592"
Jul 21 17:13:47.994847 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:47.994820    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsdh6\" (UniqueName: \"kubernetes.io/projected/3fc33bb0-8b93-4ccf-b410-a1de965a6464-kube-api-access-lsdh6\") pod \"test-curl-7497-139965123660592\" (UID: \"3fc33bb0-8b93-4ccf-b410-a1de965a6464\") " pod="opendatahub/test-curl-7497-139965123660592"
Jul 21 17:13:48.004339 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:48.004310    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsdh6\" (UniqueName: \"kubernetes.io/projected/3fc33bb0-8b93-4ccf-b410-a1de965a6464-kube-api-access-lsdh6\") pod \"test-curl-7497-139965123660592\" (UID: \"3fc33bb0-8b93-4ccf-b410-a1de965a6464\") " pod="opendatahub/test-curl-7497-139965123660592"
Jul 21 17:13:48.127796 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:48.127732    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123660592"
Jul 21 17:13:48.262848 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:48.262806    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139965123660592"]
Jul 21 17:13:48.263785 ip-10-0-135-103 kubenswrapper[2524]: W0721 17:13:48.263755    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fc33bb0_8b93_4ccf_b410_a1de965a6464.slice/crio-607b7bf748d9cf4d05eccb89b1581968a9116a74155ac1fe068def4a87d52dfe WatchSource:0}: Error finding container 607b7bf748d9cf4d05eccb89b1581968a9116a74155ac1fe068def4a87d52dfe: Status 404 returned error can't find the container with id 607b7bf748d9cf4d05eccb89b1581968a9116a74155ac1fe068def4a87d52dfe
Jul 21 17:13:48.265251 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:48.265226    2524 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:13:48.957187 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:48.957153    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139965123660592" event={"ID":"3fc33bb0-8b93-4ccf-b410-a1de965a6464","Type":"ContainerStarted","Data":"607b7bf748d9cf4d05eccb89b1581968a9116a74155ac1fe068def4a87d52dfe"}
Jul 21 17:13:49.964225 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:49.964190    2524 generic.go:356] "Generic (PLEG): container finished" podID="3fc33bb0-8b93-4ccf-b410-a1de965a6464" containerID="a8abd30658e6edd088fa7b6eaf1e15678bb7d6d842bc003652fd51db2268a793" exitCode=0
Jul 21 17:13:49.964640 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:49.964276    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139965123660592" event={"ID":"3fc33bb0-8b93-4ccf-b410-a1de965a6464","Type":"ContainerDied","Data":"a8abd30658e6edd088fa7b6eaf1e15678bb7d6d842bc003652fd51db2268a793"}
Jul 21 17:13:51.114631 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.114604    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123660592"
Jul 21 17:13:51.126413 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.126379    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsdh6\" (UniqueName: \"kubernetes.io/projected/3fc33bb0-8b93-4ccf-b410-a1de965a6464-kube-api-access-lsdh6\") pod \"3fc33bb0-8b93-4ccf-b410-a1de965a6464\" (UID: \"3fc33bb0-8b93-4ccf-b410-a1de965a6464\") "
Jul 21 17:13:51.128612 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.128577    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc33bb0-8b93-4ccf-b410-a1de965a6464-kube-api-access-lsdh6" (OuterVolumeSpecName: "kube-api-access-lsdh6") pod "3fc33bb0-8b93-4ccf-b410-a1de965a6464" (UID: "3fc33bb0-8b93-4ccf-b410-a1de965a6464"). InnerVolumeSpecName "kube-api-access-lsdh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:13:51.149972 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.149947    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7497-139965123660592_3fc33bb0-8b93-4ccf-b410-a1de965a6464/test-curl-7497-139965123660592/0.log"
Jul 21 17:13:51.176017 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.175983    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-139965123660592"]
Jul 21 17:13:51.179479 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.179455    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-139965123660592"]
Jul 21 17:13:51.228238 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.228158    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsdh6\" (UniqueName: \"kubernetes.io/projected/3fc33bb0-8b93-4ccf-b410-a1de965a6464-kube-api-access-lsdh6\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 17:13:51.298539 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.298480    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-139965123661232"]
Jul 21 17:13:51.298937 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.298924    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc33bb0-8b93-4ccf-b410-a1de965a6464" containerName="test-curl-7497-139965123660592"
Jul 21 17:13:51.298977 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.298939    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc33bb0-8b93-4ccf-b410-a1de965a6464" containerName="test-curl-7497-139965123660592"
Jul 21 17:13:51.299011 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.299001    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc33bb0-8b93-4ccf-b410-a1de965a6464" containerName="test-curl-7497-139965123660592"
Jul 21 17:13:51.302406 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.302388    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123661232"
Jul 21 17:13:51.311720 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.311430    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139965123661232"]
Jul 21 17:13:51.328765 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.328724    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rfdt\" (UniqueName: \"kubernetes.io/projected/3118ea58-1d45-47ae-b525-97459e8a82d4-kube-api-access-9rfdt\") pod \"test-curl-7497-139965123661232\" (UID: \"3118ea58-1d45-47ae-b525-97459e8a82d4\") " pod="opendatahub/test-curl-7497-139965123661232"
Jul 21 17:13:51.430319 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.430279    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rfdt\" (UniqueName: \"kubernetes.io/projected/3118ea58-1d45-47ae-b525-97459e8a82d4-kube-api-access-9rfdt\") pod \"test-curl-7497-139965123661232\" (UID: \"3118ea58-1d45-47ae-b525-97459e8a82d4\") " pod="opendatahub/test-curl-7497-139965123661232"
Jul 21 17:13:51.439253 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.439222    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rfdt\" (UniqueName: \"kubernetes.io/projected/3118ea58-1d45-47ae-b525-97459e8a82d4-kube-api-access-9rfdt\") pod \"test-curl-7497-139965123661232\" (UID: \"3118ea58-1d45-47ae-b525-97459e8a82d4\") " pod="opendatahub/test-curl-7497-139965123661232"
Jul 21 17:13:51.614264 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.614224    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123661232"
Jul 21 17:13:51.756076 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.756051    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139965123661232"]
Jul 21 17:13:51.757616 ip-10-0-135-103 kubenswrapper[2524]: W0721 17:13:51.757591    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3118ea58_1d45_47ae_b525_97459e8a82d4.slice/crio-7c6af3b6bc67d712b76319a08cea91618c77e84449ee86830536ab5e8f931e23 WatchSource:0}: Error finding container 7c6af3b6bc67d712b76319a08cea91618c77e84449ee86830536ab5e8f931e23: Status 404 returned error can't find the container with id 7c6af3b6bc67d712b76319a08cea91618c77e84449ee86830536ab5e8f931e23
Jul 21 17:13:51.977391 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.977263    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139965123661232" event={"ID":"3118ea58-1d45-47ae-b525-97459e8a82d4","Type":"ContainerStarted","Data":"7c6af3b6bc67d712b76319a08cea91618c77e84449ee86830536ab5e8f931e23"}
Jul 21 17:13:51.978502 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.978484    2524 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="607b7bf748d9cf4d05eccb89b1581968a9116a74155ac1fe068def4a87d52dfe"
Jul 21 17:13:51.978675 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:51.978537    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123660592"
Jul 21 17:13:51.989275 ip-10-0-135-103 kubenswrapper[2524]: E0721 17:13:51.989250    2524 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7497-139965123660592\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" podUID="3fc33bb0-8b93-4ccf-b410-a1de965a6464" pod="opendatahub/test-curl-7497-139965123660592"
Jul 21 17:13:52.061389 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:52.061360    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fc33bb0-8b93-4ccf-b410-a1de965a6464" path="/var/lib/kubelet/pods/3fc33bb0-8b93-4ccf-b410-a1de965a6464/volumes"
Jul 21 17:13:52.986251 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:52.986218    2524 generic.go:356] "Generic (PLEG): container finished" podID="3118ea58-1d45-47ae-b525-97459e8a82d4" containerID="9ca70512fcf68c9e2d430f5aab8bb1184bcb1ab89ce58c09a3da137f9a2e961b" exitCode=0
Jul 21 17:13:52.986724 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:52.986259    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139965123661232" event={"ID":"3118ea58-1d45-47ae-b525-97459e8a82d4","Type":"ContainerDied","Data":"9ca70512fcf68c9e2d430f5aab8bb1184bcb1ab89ce58c09a3da137f9a2e961b"}
Jul 21 17:13:54.136069 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.136042    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123661232"
Jul 21 17:13:54.156915 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.156889    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rfdt\" (UniqueName: \"kubernetes.io/projected/3118ea58-1d45-47ae-b525-97459e8a82d4-kube-api-access-9rfdt\") pod \"3118ea58-1d45-47ae-b525-97459e8a82d4\" (UID: \"3118ea58-1d45-47ae-b525-97459e8a82d4\") "
Jul 21 17:13:54.159137 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.159107    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7497-139965123661232_3118ea58-1d45-47ae-b525-97459e8a82d4/test-curl-7497-139965123661232/0.log"
Jul 21 17:13:54.159474 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.159455    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3118ea58-1d45-47ae-b525-97459e8a82d4-kube-api-access-9rfdt" (OuterVolumeSpecName: "kube-api-access-9rfdt") pod "3118ea58-1d45-47ae-b525-97459e8a82d4" (UID: "3118ea58-1d45-47ae-b525-97459e8a82d4"). InnerVolumeSpecName "kube-api-access-9rfdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:13:54.183501 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.183474    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-139965123661232"]
Jul 21 17:13:54.185802 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.185783    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-139965123661232"]
Jul 21 17:13:54.258142 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.258080    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rfdt\" (UniqueName: \"kubernetes.io/projected/3118ea58-1d45-47ae-b525-97459e8a82d4-kube-api-access-9rfdt\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 17:13:54.345118 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.345089    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-139965123564576"]
Jul 21 17:13:54.345548 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.345535    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3118ea58-1d45-47ae-b525-97459e8a82d4" containerName="test-curl-7497-139965123661232"
Jul 21 17:13:54.345599 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.345550    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="3118ea58-1d45-47ae-b525-97459e8a82d4" containerName="test-curl-7497-139965123661232"
Jul 21 17:13:54.345638 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.345616    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="3118ea58-1d45-47ae-b525-97459e8a82d4" containerName="test-curl-7497-139965123661232"
Jul 21 17:13:54.348700 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.348683    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:13:54.353570 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.353541    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139965123564576"]
Jul 21 17:13:54.460094 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.460064    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcs6h\" (UniqueName: \"kubernetes.io/projected/0c5b3203-56bb-41fe-bb0c-e8c47a899fba-kube-api-access-gcs6h\") pod \"test-curl-7497-139965123564576\" (UID: \"0c5b3203-56bb-41fe-bb0c-e8c47a899fba\") " pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:13:54.561176 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.561147    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcs6h\" (UniqueName: \"kubernetes.io/projected/0c5b3203-56bb-41fe-bb0c-e8c47a899fba-kube-api-access-gcs6h\") pod \"test-curl-7497-139965123564576\" (UID: \"0c5b3203-56bb-41fe-bb0c-e8c47a899fba\") " pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:13:54.570498 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.570469    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcs6h\" (UniqueName: \"kubernetes.io/projected/0c5b3203-56bb-41fe-bb0c-e8c47a899fba-kube-api-access-gcs6h\") pod \"test-curl-7497-139965123564576\" (UID: \"0c5b3203-56bb-41fe-bb0c-e8c47a899fba\") " pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:13:54.659224 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.659192    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:13:54.796654 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.796628    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139965123564576"]
Jul 21 17:13:54.797553 ip-10-0-135-103 kubenswrapper[2524]: W0721 17:13:54.797526    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c5b3203_56bb_41fe_bb0c_e8c47a899fba.slice/crio-76af5f250da3b36887b3e5bccbd39b1933d16d913252e604331b342b943f0d79 WatchSource:0}: Error finding container 76af5f250da3b36887b3e5bccbd39b1933d16d913252e604331b342b943f0d79: Status 404 returned error can't find the container with id 76af5f250da3b36887b3e5bccbd39b1933d16d913252e604331b342b943f0d79
Jul 21 17:13:54.999358 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:54.999320    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139965123564576" event={"ID":"0c5b3203-56bb-41fe-bb0c-e8c47a899fba","Type":"ContainerStarted","Data":"76af5f250da3b36887b3e5bccbd39b1933d16d913252e604331b342b943f0d79"}
Jul 21 17:13:55.000551 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:55.000530    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123661232"
Jul 21 17:13:55.000679 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:55.000536    2524 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c6af3b6bc67d712b76319a08cea91618c77e84449ee86830536ab5e8f931e23"
Jul 21 17:13:55.013965 ip-10-0-135-103 kubenswrapper[2524]: E0721 17:13:55.013941    2524 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7497-139965123661232\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" podUID="3118ea58-1d45-47ae-b525-97459e8a82d4" pod="opendatahub/test-curl-7497-139965123661232"
Jul 21 17:13:56.008630 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:56.008596    2524 generic.go:356] "Generic (PLEG): container finished" podID="0c5b3203-56bb-41fe-bb0c-e8c47a899fba" containerID="a29c07a98c4df53d8bb8d6fdd3e873c3f9eae5d6cc8dd69b777acf4cc0c7a5c2" exitCode=0
Jul 21 17:13:56.009019 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:56.008696    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139965123564576" event={"ID":"0c5b3203-56bb-41fe-bb0c-e8c47a899fba","Type":"ContainerDied","Data":"a29c07a98c4df53d8bb8d6fdd3e873c3f9eae5d6cc8dd69b777acf4cc0c7a5c2"}
Jul 21 17:13:56.011020 ip-10-0-135-103 kubenswrapper[2524]: E0721 17:13:56.010998    2524 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7497-139965123661232\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" podUID="3118ea58-1d45-47ae-b525-97459e8a82d4" pod="opendatahub/test-curl-7497-139965123661232"
Jul 21 17:13:56.060486 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:56.060461    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3118ea58-1d45-47ae-b525-97459e8a82d4" path="/var/lib/kubelet/pods/3118ea58-1d45-47ae-b525-97459e8a82d4/volumes"
Jul 21 17:13:57.170021 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.169992    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:13:57.197160 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.197134    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7497-139965123564576_0c5b3203-56bb-41fe-bb0c-e8c47a899fba/test-curl-7497-139965123564576/0.log"
Jul 21 17:13:57.224210 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.224172    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-139965123564576"]
Jul 21 17:13:57.229762 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.229735    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-139965123564576"]
Jul 21 17:13:57.283991 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.283909    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcs6h\" (UniqueName: \"kubernetes.io/projected/0c5b3203-56bb-41fe-bb0c-e8c47a899fba-kube-api-access-gcs6h\") pod \"0c5b3203-56bb-41fe-bb0c-e8c47a899fba\" (UID: \"0c5b3203-56bb-41fe-bb0c-e8c47a899fba\") "
Jul 21 17:13:57.286080 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.286056    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c5b3203-56bb-41fe-bb0c-e8c47a899fba-kube-api-access-gcs6h" (OuterVolumeSpecName: "kube-api-access-gcs6h") pod "0c5b3203-56bb-41fe-bb0c-e8c47a899fba" (UID: "0c5b3203-56bb-41fe-bb0c-e8c47a899fba"). InnerVolumeSpecName "kube-api-access-gcs6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:13:57.379755 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.379718    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-139965123564576"]
Jul 21 17:13:57.380188 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.380173    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5b3203-56bb-41fe-bb0c-e8c47a899fba" containerName="test-curl-7497-139965123564576"
Jul 21 17:13:57.380237 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.380190    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5b3203-56bb-41fe-bb0c-e8c47a899fba" containerName="test-curl-7497-139965123564576"
Jul 21 17:13:57.380275 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.380266    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c5b3203-56bb-41fe-bb0c-e8c47a899fba" containerName="test-curl-7497-139965123564576"
Jul 21 17:13:57.383410 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.383393    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:13:57.384836 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.384812    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcs6h\" (UniqueName: \"kubernetes.io/projected/0c5b3203-56bb-41fe-bb0c-e8c47a899fba-kube-api-access-gcs6h\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 17:13:57.397892 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.397862    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139965123564576"]
Jul 21 17:13:57.485668 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.485634    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbp96\" (UniqueName: \"kubernetes.io/projected/08c9d7ae-cf0b-4806-8f33-475194ccdda2-kube-api-access-gbp96\") pod \"test-curl-7497-139965123564576\" (UID: \"08c9d7ae-cf0b-4806-8f33-475194ccdda2\") " pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:13:57.586504 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.586413    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbp96\" (UniqueName: \"kubernetes.io/projected/08c9d7ae-cf0b-4806-8f33-475194ccdda2-kube-api-access-gbp96\") pod \"test-curl-7497-139965123564576\" (UID: \"08c9d7ae-cf0b-4806-8f33-475194ccdda2\") " pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:13:57.600002 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.599974    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbp96\" (UniqueName: \"kubernetes.io/projected/08c9d7ae-cf0b-4806-8f33-475194ccdda2-kube-api-access-gbp96\") pod \"test-curl-7497-139965123564576\" (UID: \"08c9d7ae-cf0b-4806-8f33-475194ccdda2\") " pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:13:57.692168 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.692133    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:13:57.829051 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:57.829026    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139965123564576"]
Jul 21 17:13:57.830170 ip-10-0-135-103 kubenswrapper[2524]: W0721 17:13:57.830139    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08c9d7ae_cf0b_4806_8f33_475194ccdda2.slice/crio-f1e970828d4ad9ac04fe65ba2a3af9baaae7ab9b19bbf3938604593a89a9c507 WatchSource:0}: Error finding container f1e970828d4ad9ac04fe65ba2a3af9baaae7ab9b19bbf3938604593a89a9c507: Status 404 returned error can't find the container with id f1e970828d4ad9ac04fe65ba2a3af9baaae7ab9b19bbf3938604593a89a9c507
Jul 21 17:13:58.022022 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:58.021990    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:13:58.022022 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:58.022020    2524 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76af5f250da3b36887b3e5bccbd39b1933d16d913252e604331b342b943f0d79"
Jul 21 17:13:58.023393 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:58.023366    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139965123564576" event={"ID":"08c9d7ae-cf0b-4806-8f33-475194ccdda2","Type":"ContainerStarted","Data":"f1e970828d4ad9ac04fe65ba2a3af9baaae7ab9b19bbf3938604593a89a9c507"}
Jul 21 17:13:58.034440 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:58.034411    2524 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7497-139965123564576" oldPodUID="0c5b3203-56bb-41fe-bb0c-e8c47a899fba" podUID="08c9d7ae-cf0b-4806-8f33-475194ccdda2"
Jul 21 17:13:58.060848 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:58.060824    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c5b3203-56bb-41fe-bb0c-e8c47a899fba" path="/var/lib/kubelet/pods/0c5b3203-56bb-41fe-bb0c-e8c47a899fba/volumes"
Jul 21 17:13:59.030377 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:59.030344    2524 generic.go:356] "Generic (PLEG): container finished" podID="08c9d7ae-cf0b-4806-8f33-475194ccdda2" containerID="a81a2c05214d503642a9c3557b2df1cbbab47c70cb0ebcc5d921c3f3b2f51849" exitCode=0
Jul 21 17:13:59.030765 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:13:59.030437    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139965123564576" event={"ID":"08c9d7ae-cf0b-4806-8f33-475194ccdda2","Type":"ContainerDied","Data":"a81a2c05214d503642a9c3557b2df1cbbab47c70cb0ebcc5d921c3f3b2f51849"}
Jul 21 17:14:00.178797 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.178774    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:14:00.200450 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.200427    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7497-139965123564576_08c9d7ae-cf0b-4806-8f33-475194ccdda2/test-curl-7497-139965123564576/0.log"
Jul 21 17:14:00.212841 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.212820    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbp96\" (UniqueName: \"kubernetes.io/projected/08c9d7ae-cf0b-4806-8f33-475194ccdda2-kube-api-access-gbp96\") pod \"08c9d7ae-cf0b-4806-8f33-475194ccdda2\" (UID: \"08c9d7ae-cf0b-4806-8f33-475194ccdda2\") "
Jul 21 17:14:00.214942 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.214921    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08c9d7ae-cf0b-4806-8f33-475194ccdda2-kube-api-access-gbp96" (OuterVolumeSpecName: "kube-api-access-gbp96") pod "08c9d7ae-cf0b-4806-8f33-475194ccdda2" (UID: "08c9d7ae-cf0b-4806-8f33-475194ccdda2"). InnerVolumeSpecName "kube-api-access-gbp96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:14:00.224294 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.224264    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-139965123564576"]
Jul 21 17:14:00.226773 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.226752    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-139965123564576"]
Jul 21 17:14:00.314261 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.314190    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbp96\" (UniqueName: \"kubernetes.io/projected/08c9d7ae-cf0b-4806-8f33-475194ccdda2-kube-api-access-gbp96\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 17:14:00.344925 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.344899    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-139965123565584"]
Jul 21 17:14:00.345339 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.345326    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08c9d7ae-cf0b-4806-8f33-475194ccdda2" containerName="test-curl-7497-139965123564576"
Jul 21 17:14:00.345386 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.345341    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="08c9d7ae-cf0b-4806-8f33-475194ccdda2" containerName="test-curl-7497-139965123564576"
Jul 21 17:14:00.345423 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.345404    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="08c9d7ae-cf0b-4806-8f33-475194ccdda2" containerName="test-curl-7497-139965123564576"
Jul 21 17:14:00.356825 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.356778    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139965123565584"]
Jul 21 17:14:00.356999 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.356964    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123565584"
Jul 21 17:14:00.415334 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.415301    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7skwk\" (UniqueName: \"kubernetes.io/projected/1b17a7be-d7a0-4cb0-9730-ea8b26b2f397-kube-api-access-7skwk\") pod \"test-curl-7497-139965123565584\" (UID: \"1b17a7be-d7a0-4cb0-9730-ea8b26b2f397\") " pod="opendatahub/test-curl-7497-139965123565584"
Jul 21 17:14:00.516335 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.516300    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7skwk\" (UniqueName: \"kubernetes.io/projected/1b17a7be-d7a0-4cb0-9730-ea8b26b2f397-kube-api-access-7skwk\") pod \"test-curl-7497-139965123565584\" (UID: \"1b17a7be-d7a0-4cb0-9730-ea8b26b2f397\") " pod="opendatahub/test-curl-7497-139965123565584"
Jul 21 17:14:00.525214 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.525185    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7skwk\" (UniqueName: \"kubernetes.io/projected/1b17a7be-d7a0-4cb0-9730-ea8b26b2f397-kube-api-access-7skwk\") pod \"test-curl-7497-139965123565584\" (UID: \"1b17a7be-d7a0-4cb0-9730-ea8b26b2f397\") " pod="opendatahub/test-curl-7497-139965123565584"
Jul 21 17:14:00.666575 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.666471    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123565584"
Jul 21 17:14:00.803480 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:00.803452    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139965123565584"]
Jul 21 17:14:00.804003 ip-10-0-135-103 kubenswrapper[2524]: W0721 17:14:00.803974    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b17a7be_d7a0_4cb0_9730_ea8b26b2f397.slice/crio-d88f05b033925c8ce0550073804224014e9ff0e77671e91511f4851ed927a05b WatchSource:0}: Error finding container d88f05b033925c8ce0550073804224014e9ff0e77671e91511f4851ed927a05b: Status 404 returned error can't find the container with id d88f05b033925c8ce0550073804224014e9ff0e77671e91511f4851ed927a05b
Jul 21 17:14:01.044877 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:01.044849    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:14:01.044877 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:01.044874    2524 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1e970828d4ad9ac04fe65ba2a3af9baaae7ab9b19bbf3938604593a89a9c507"
Jul 21 17:14:01.046111 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:01.046087    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139965123565584" event={"ID":"1b17a7be-d7a0-4cb0-9730-ea8b26b2f397","Type":"ContainerStarted","Data":"d88f05b033925c8ce0550073804224014e9ff0e77671e91511f4851ed927a05b"}
Jul 21 17:14:01.055552 ip-10-0-135-103 kubenswrapper[2524]: E0721 17:14:01.055500    2524 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7497-139965123564576\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" podUID="08c9d7ae-cf0b-4806-8f33-475194ccdda2" pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:14:02.053226 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:02.053185    2524 generic.go:356] "Generic (PLEG): container finished" podID="1b17a7be-d7a0-4cb0-9730-ea8b26b2f397" containerID="e26a70d5935cec702e88d37eef97bb17a5e240d5a19b179a60c87e0ce9b04b98" exitCode=0
Jul 21 17:14:02.053702 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:02.053292    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139965123565584" event={"ID":"1b17a7be-d7a0-4cb0-9730-ea8b26b2f397","Type":"ContainerDied","Data":"e26a70d5935cec702e88d37eef97bb17a5e240d5a19b179a60c87e0ce9b04b98"}
Jul 21 17:14:02.060599 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:02.060575    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08c9d7ae-cf0b-4806-8f33-475194ccdda2" path="/var/lib/kubelet/pods/08c9d7ae-cf0b-4806-8f33-475194ccdda2/volumes"
Jul 21 17:14:02.070982 ip-10-0-135-103 kubenswrapper[2524]: E0721 17:14:02.070951    2524 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7497-139965123564576\" is forbidden: User \"system:node:ip-10-0-135-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-103.ec2.internal' and this object" podUID="08c9d7ae-cf0b-4806-8f33-475194ccdda2" pod="opendatahub/test-curl-7497-139965123564576"
Jul 21 17:14:03.194950 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:03.194924    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123565584"
Jul 21 17:14:03.215654 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:03.215632    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7497-139965123565584_1b17a7be-d7a0-4cb0-9730-ea8b26b2f397/test-curl-7497-139965123565584/0.log"
Jul 21 17:14:03.237717 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:03.237685    2524 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-139965123565584"]
Jul 21 17:14:03.241712 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:03.241687    2524 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-139965123565584"]
Jul 21 17:14:03.242531 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:03.242492    2524 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7skwk\" (UniqueName: \"kubernetes.io/projected/1b17a7be-d7a0-4cb0-9730-ea8b26b2f397-kube-api-access-7skwk\") pod \"1b17a7be-d7a0-4cb0-9730-ea8b26b2f397\" (UID: \"1b17a7be-d7a0-4cb0-9730-ea8b26b2f397\") "
Jul 21 17:14:03.244622 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:03.244600    2524 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b17a7be-d7a0-4cb0-9730-ea8b26b2f397-kube-api-access-7skwk" (OuterVolumeSpecName: "kube-api-access-7skwk") pod "1b17a7be-d7a0-4cb0-9730-ea8b26b2f397" (UID: "1b17a7be-d7a0-4cb0-9730-ea8b26b2f397"). InnerVolumeSpecName "kube-api-access-7skwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:14:03.343896 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:03.343820    2524 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7skwk\" (UniqueName: \"kubernetes.io/projected/1b17a7be-d7a0-4cb0-9730-ea8b26b2f397-kube-api-access-7skwk\") on node \"ip-10-0-135-103.ec2.internal\" DevicePath \"\""
Jul 21 17:14:04.062203 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:04.062170    2524 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b17a7be-d7a0-4cb0-9730-ea8b26b2f397" path="/var/lib/kubelet/pods/1b17a7be-d7a0-4cb0-9730-ea8b26b2f397/volumes"
Jul 21 17:14:04.067654 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:04.067626    2524 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139965123565584"
Jul 21 17:14:04.067774 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:04.067661    2524 scope.go:117] "RemoveContainer" containerID="e26a70d5935cec702e88d37eef97bb17a5e240d5a19b179a60c87e0ce9b04b98"
Jul 21 17:14:51.434332 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:51.434246    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-57cd47b448-gxmgs_57825062-7dc0-4d85-afe5-831df64f0283/authorino/0.log"
Jul 21 17:14:56.686852 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:56.686821    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-svvfk_db6084af-9742-46a8-9e77-7e88980bf63a/manager/0.log"
Jul 21 17:14:56.805992 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:56.805969    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4wj94_85d31a95-be9f-4a27-9697-c8d8ba0adb09/manager/0.log"
Jul 21 17:14:57.050442 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:57.050415    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cqqhm_170a0bc5-278a-4cb7-bd6d-36e237d70a71/server/0.log"
Jul 21 17:14:57.160807 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:57.160783    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gps9z_8bd2cae8-19f9-4921-9d50-3227f565d372/manager/0.log"
Jul 21 17:14:57.273826 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:57.273805    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87c9445c4-g6msx_fe8262ab-56cd-4d51-88bf-2f04bbb934e9/copy-manifests/0.log"
Jul 21 17:14:57.279714 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:57.279693    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87c9445c4-g6msx_fe8262ab-56cd-4d51-88bf-2f04bbb934e9/manager/0.log"
Jul 21 17:14:58.167330 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:58.167303    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-thqlx_c31b0c69-863f-470b-b275-31db7b4101b8/postgres/0.log"
Jul 21 17:14:58.918131 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:58.918102    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt_4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24/pull/0.log"
Jul 21 17:14:58.926423 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:58.926398    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt_4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24/extract/0.log"
Jul 21 17:14:58.933455 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:58.933440    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt_4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24/util/0.log"
Jul 21 17:14:59.034936 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:59.034912    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd_2d73dbd4-f6c0-4f0b-8978-f137da3a53b1/pull/0.log"
Jul 21 17:14:59.041365 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:59.041344    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd_2d73dbd4-f6c0-4f0b-8978-f137da3a53b1/extract/0.log"
Jul 21 17:14:59.047238 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:59.047222    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd_2d73dbd4-f6c0-4f0b-8978-f137da3a53b1/util/0.log"
Jul 21 17:14:59.151109 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:59.151084    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj_4dcd8c71-4e70-4f1c-993b-04b6895b7d0a/util/0.log"
Jul 21 17:14:59.157049 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:59.157030    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj_4dcd8c71-4e70-4f1c-993b-04b6895b7d0a/pull/0.log"
Jul 21 17:14:59.163126 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:59.163110    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj_4dcd8c71-4e70-4f1c-993b-04b6895b7d0a/extract/0.log"
Jul 21 17:14:59.270779 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:59.270763    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2_cb3eb07e-ee39-4630-bb53-47987c19184a/util/0.log"
Jul 21 17:14:59.277983 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:59.277966    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2_cb3eb07e-ee39-4630-bb53-47987c19184a/pull/0.log"
Jul 21 17:14:59.283816 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:59.283801    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2_cb3eb07e-ee39-4630-bb53-47987c19184a/extract/0.log"
Jul 21 17:14:59.400756 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:59.400734    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-57cd47b448-gxmgs_57825062-7dc0-4d85-afe5-831df64f0283/authorino/0.log"
Jul 21 17:14:59.513190 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:59.513173    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wzn4w_c9e6f83b-ad70-4d3f-92da-5696b4d8b2ca/manager/0.log"
Jul 21 17:14:59.618289 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:59.618232    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-k6k5n_e79750b5-f399-4e50-a69a-6f179a0995ac/manager/0.log"
Jul 21 17:14:59.724464 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:59.724444    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vk5ll_7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5/kuadrant-console-plugin/0.log"
Jul 21 17:14:59.842403 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:59.842384    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jq8l7_1ff36980-7927-45fd-8948-9724f58d9c07/registry-server/0.log"
Jul 21 17:14:59.954228 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:14:59.954177    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rchng_737e44fe-5552-4156-86ad-9f33328e4855/manager/0.log"
Jul 21 17:15:00.508663 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:00.508637    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qdz2x_65804d3f-c34e-4152-92f8-523d3be0d7d0/istio-proxy/0.log"
Jul 21 17:15:00.731036 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:00.731013    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d77f95f8-6hhsz_f1dcecd2-3bd2-4287-a6ef-235681541284/kube-auth-proxy/0.log"
Jul 21 17:15:00.952878 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:00.952853    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hs8sg_0390849d-de27-4991-81bc-3d3156217d98/istio-proxy/1.log"
Jul 21 17:15:01.181106 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:01.181062    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-p62qp_ba91a689-60db-4bb1-b449-65df45c9d879/payload-processing/0.log"
Jul 21 17:15:01.632324 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:01.632305    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-m57l8_e35e5eaf-2d7d-4160-ac31-880bc4577d22/main/0.log"
Jul 21 17:15:01.760294 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:01.760274    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-8zhhn_b2769332-de23-4911-9506-c2e15b590204/main/0.log"
Jul 21 17:15:02.101788 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:02.101766    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4ggs7_c125759c-1533-42b1-9e25-c321f83098b9/main/0.log"
Jul 21 17:15:10.332682 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:10.332655    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2fs5t_1be3dca0-631a-4ebd-9bfc-2cb14e931f47/global-pull-secret-syncer/0.log"
Jul 21 17:15:10.504747 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:10.504720    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fsdc4_e501c98a-cee2-4fcd-a73f-17833cd531f8/konnectivity-agent/0.log"
Jul 21 17:15:10.582907 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:10.582833    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-103.ec2.internal_aa5cb37ed5f2f1567e0eabefb71356fb/haproxy/0.log"
Jul 21 17:15:15.039761 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.039734    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt_4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24/extract/0.log"
Jul 21 17:15:15.080482 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.080458    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt_4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24/util/0.log"
Jul 21 17:15:15.126608 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.126590    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75928zpt_4b4089f9-1a90-4e87-a1ae-e7fe51f1fb24/pull/0.log"
Jul 21 17:15:15.183112 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.183090    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd_2d73dbd4-f6c0-4f0b-8978-f137da3a53b1/extract/0.log"
Jul 21 17:15:15.232287 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.232266    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd_2d73dbd4-f6c0-4f0b-8978-f137da3a53b1/util/0.log"
Jul 21 17:15:15.274365 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.274345    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e077scd_2d73dbd4-f6c0-4f0b-8978-f137da3a53b1/pull/0.log"
Jul 21 17:15:15.316406 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.316360    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj_4dcd8c71-4e70-4f1c-993b-04b6895b7d0a/extract/0.log"
Jul 21 17:15:15.339866 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.339850    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj_4dcd8c71-4e70-4f1c-993b-04b6895b7d0a/util/0.log"
Jul 21 17:15:15.363753 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.363733    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xfxkj_4dcd8c71-4e70-4f1c-993b-04b6895b7d0a/pull/0.log"
Jul 21 17:15:15.393208 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.393191    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2_cb3eb07e-ee39-4630-bb53-47987c19184a/extract/0.log"
Jul 21 17:15:15.418092 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.418072    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2_cb3eb07e-ee39-4630-bb53-47987c19184a/util/0.log"
Jul 21 17:15:15.439766 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.439747    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qr8g2_cb3eb07e-ee39-4630-bb53-47987c19184a/pull/0.log"
Jul 21 17:15:15.762331 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.762251    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-57cd47b448-gxmgs_57825062-7dc0-4d85-afe5-831df64f0283/authorino/0.log"
Jul 21 17:15:15.792669 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.792636    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wzn4w_c9e6f83b-ad70-4d3f-92da-5696b4d8b2ca/manager/0.log"
Jul 21 17:15:15.822284 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.822258    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-k6k5n_e79750b5-f399-4e50-a69a-6f179a0995ac/manager/0.log"
Jul 21 17:15:15.847428 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.847406    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vk5ll_7e6c64af-ae0f-4b03-8b3a-1ff8fa7560c5/kuadrant-console-plugin/0.log"
Jul 21 17:15:15.885203 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:15.885181    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jq8l7_1ff36980-7927-45fd-8948-9724f58d9c07/registry-server/0.log"
Jul 21 17:15:16.015148 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:16.015086    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rchng_737e44fe-5552-4156-86ad-9f33328e4855/manager/0.log"
Jul 21 17:15:17.791482 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:17.791455    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ef99172-7100-426e-8c1f-cffe2e6423d5/alertmanager/0.log"
Jul 21 17:15:17.817229 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:17.817211    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ef99172-7100-426e-8c1f-cffe2e6423d5/config-reloader/0.log"
Jul 21 17:15:17.848404 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:17.848382    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ef99172-7100-426e-8c1f-cffe2e6423d5/kube-rbac-proxy-web/0.log"
Jul 21 17:15:17.874579 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:17.874558    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ef99172-7100-426e-8c1f-cffe2e6423d5/kube-rbac-proxy/0.log"
Jul 21 17:15:17.894009 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:17.893991    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ef99172-7100-426e-8c1f-cffe2e6423d5/kube-rbac-proxy-metric/0.log"
Jul 21 17:15:17.918445 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:17.918424    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ef99172-7100-426e-8c1f-cffe2e6423d5/prom-label-proxy/0.log"
Jul 21 17:15:17.939815 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:17.939796    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0ef99172-7100-426e-8c1f-cffe2e6423d5/init-config-reloader/0.log"
Jul 21 17:15:18.045243 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:18.045189    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-8kjwl_523f17a8-d68a-47b8-be62-575741504f5e/kube-state-metrics/0.log"
Jul 21 17:15:18.074282 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:18.074260    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-8kjwl_523f17a8-d68a-47b8-be62-575741504f5e/kube-rbac-proxy-main/0.log"
Jul 21 17:15:18.099161 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:18.099143    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-8kjwl_523f17a8-d68a-47b8-be62-575741504f5e/kube-rbac-proxy-self/0.log"
Jul 21 17:15:18.370985 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:18.370920    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mslxv_8b875b9f-8a31-4558-a596-988af905cd45/node-exporter/0.log"
Jul 21 17:15:18.393756 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:18.393736    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mslxv_8b875b9f-8a31-4558-a596-988af905cd45/kube-rbac-proxy/0.log"
Jul 21 17:15:18.427062 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:18.427040    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mslxv_8b875b9f-8a31-4558-a596-988af905cd45/init-textfile/0.log"
Jul 21 17:15:18.821502 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:18.821481    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-676ff654f7-5wjjr_47463d3e-76fd-4900-97e9-e5cbfeaffeec/telemeter-client/0.log"
Jul 21 17:15:18.845140 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:18.845124    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-676ff654f7-5wjjr_47463d3e-76fd-4900-97e9-e5cbfeaffeec/reload/0.log"
Jul 21 17:15:18.868025 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:18.868002    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-676ff654f7-5wjjr_47463d3e-76fd-4900-97e9-e5cbfeaffeec/kube-rbac-proxy/0.log"
Jul 21 17:15:18.902422 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:18.902407    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8697f86689-t2b48_3f8254e5-d726-4885-b4fe-617ae01adbf3/thanos-query/0.log"
Jul 21 17:15:18.929925 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:18.929911    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8697f86689-t2b48_3f8254e5-d726-4885-b4fe-617ae01adbf3/kube-rbac-proxy-web/0.log"
Jul 21 17:15:18.954817 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:18.954763    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8697f86689-t2b48_3f8254e5-d726-4885-b4fe-617ae01adbf3/kube-rbac-proxy/0.log"
Jul 21 17:15:18.983819 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:18.983801    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8697f86689-t2b48_3f8254e5-d726-4885-b4fe-617ae01adbf3/prom-label-proxy/0.log"
Jul 21 17:15:19.006212 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:19.006193    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8697f86689-t2b48_3f8254e5-d726-4885-b4fe-617ae01adbf3/kube-rbac-proxy-rules/0.log"
Jul 21 17:15:19.028318 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:19.028303    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8697f86689-t2b48_3f8254e5-d726-4885-b4fe-617ae01adbf3/kube-rbac-proxy-metrics/0.log"
Jul 21 17:15:20.899741 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:20.899715    2524 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"]
Jul 21 17:15:20.900247 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:20.900231    2524 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b17a7be-d7a0-4cb0-9730-ea8b26b2f397" containerName="test-curl-7497-139965123565584"
Jul 21 17:15:20.900294 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:20.900250    2524 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b17a7be-d7a0-4cb0-9730-ea8b26b2f397" containerName="test-curl-7497-139965123565584"
Jul 21 17:15:20.900328 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:20.900320    2524 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b17a7be-d7a0-4cb0-9730-ea8b26b2f397" containerName="test-curl-7497-139965123565584"
Jul 21 17:15:20.903665 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:20.903651    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:20.906317 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:20.906296    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nbkhg\"/\"kube-root-ca.crt\""
Jul 21 17:15:20.906438 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:20.906383    2524 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nbkhg\"/\"openshift-service-ca.crt\""
Jul 21 17:15:20.907408 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:20.907393    2524 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nbkhg\"/\"default-dockercfg-mwnqs\""
Jul 21 17:15:20.912253 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:20.912233    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"]
Jul 21 17:15:20.920183 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:20.920160    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09778a30-1994-4965-bc54-242584ba50f6-sys\") pod \"perf-node-gather-daemonset-gjvgt\" (UID: \"09778a30-1994-4965-bc54-242584ba50f6\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:20.920256 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:20.920205    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/09778a30-1994-4965-bc54-242584ba50f6-podres\") pod \"perf-node-gather-daemonset-gjvgt\" (UID: \"09778a30-1994-4965-bc54-242584ba50f6\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:20.920256 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:20.920227    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v84c\" (UniqueName: \"kubernetes.io/projected/09778a30-1994-4965-bc54-242584ba50f6-kube-api-access-2v84c\") pod \"perf-node-gather-daemonset-gjvgt\" (UID: \"09778a30-1994-4965-bc54-242584ba50f6\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:20.920422 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:20.920397    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/09778a30-1994-4965-bc54-242584ba50f6-proc\") pod \"perf-node-gather-daemonset-gjvgt\" (UID: \"09778a30-1994-4965-bc54-242584ba50f6\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:20.920471 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:20.920455    2524 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09778a30-1994-4965-bc54-242584ba50f6-lib-modules\") pod \"perf-node-gather-daemonset-gjvgt\" (UID: \"09778a30-1994-4965-bc54-242584ba50f6\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:21.021128 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.021106    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09778a30-1994-4965-bc54-242584ba50f6-lib-modules\") pod \"perf-node-gather-daemonset-gjvgt\" (UID: \"09778a30-1994-4965-bc54-242584ba50f6\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:21.021223 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.021140    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09778a30-1994-4965-bc54-242584ba50f6-sys\") pod \"perf-node-gather-daemonset-gjvgt\" (UID: \"09778a30-1994-4965-bc54-242584ba50f6\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:21.021223 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.021195    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/09778a30-1994-4965-bc54-242584ba50f6-podres\") pod \"perf-node-gather-daemonset-gjvgt\" (UID: \"09778a30-1994-4965-bc54-242584ba50f6\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:21.021366 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.021229    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v84c\" (UniqueName: \"kubernetes.io/projected/09778a30-1994-4965-bc54-242584ba50f6-kube-api-access-2v84c\") pod \"perf-node-gather-daemonset-gjvgt\" (UID: \"09778a30-1994-4965-bc54-242584ba50f6\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:21.021366 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.021278    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09778a30-1994-4965-bc54-242584ba50f6-lib-modules\") pod \"perf-node-gather-daemonset-gjvgt\" (UID: \"09778a30-1994-4965-bc54-242584ba50f6\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:21.021366 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.021307    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09778a30-1994-4965-bc54-242584ba50f6-sys\") pod \"perf-node-gather-daemonset-gjvgt\" (UID: \"09778a30-1994-4965-bc54-242584ba50f6\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:21.021366 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.021337    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/09778a30-1994-4965-bc54-242584ba50f6-podres\") pod \"perf-node-gather-daemonset-gjvgt\" (UID: \"09778a30-1994-4965-bc54-242584ba50f6\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:21.021591 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.021498    2524 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/09778a30-1994-4965-bc54-242584ba50f6-proc\") pod \"perf-node-gather-daemonset-gjvgt\" (UID: \"09778a30-1994-4965-bc54-242584ba50f6\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:21.021631 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.021588    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/09778a30-1994-4965-bc54-242584ba50f6-proc\") pod \"perf-node-gather-daemonset-gjvgt\" (UID: \"09778a30-1994-4965-bc54-242584ba50f6\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:21.032715 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.032688    2524 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v84c\" (UniqueName: \"kubernetes.io/projected/09778a30-1994-4965-bc54-242584ba50f6-kube-api-access-2v84c\") pod \"perf-node-gather-daemonset-gjvgt\" (UID: \"09778a30-1994-4965-bc54-242584ba50f6\") " pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:21.214914 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.214855    2524 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:21.347813 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.347788    2524 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"]
Jul 21 17:15:21.348835 ip-10-0-135-103 kubenswrapper[2524]: W0721 17:15:21.348811    2524 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod09778a30_1994_4965_bc54_242584ba50f6.slice/crio-272e5a6e2f49076501a5e20e17974e2721fe2fb81489876e84ba6f851dca683e WatchSource:0}: Error finding container 272e5a6e2f49076501a5e20e17974e2721fe2fb81489876e84ba6f851dca683e: Status 404 returned error can't find the container with id 272e5a6e2f49076501a5e20e17974e2721fe2fb81489876e84ba6f851dca683e
Jul 21 17:15:21.477305 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.477238    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75f594d4d6-bflqk_d9af1a73-4824-4423-ac6e-24864fc78bbb/console/0.log"
Jul 21 17:15:21.515972 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.515945    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt" event={"ID":"09778a30-1994-4965-bc54-242584ba50f6","Type":"ContainerStarted","Data":"b1140c97a0969123d926e100f37c651794dff0f630bc3d78892f41d8dc3f044e"}
Jul 21 17:15:21.516060 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.515994    2524 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt" event={"ID":"09778a30-1994-4965-bc54-242584ba50f6","Type":"ContainerStarted","Data":"272e5a6e2f49076501a5e20e17974e2721fe2fb81489876e84ba6f851dca683e"}
Jul 21 17:15:21.516118 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.516076    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:21.533557 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:21.533497    2524 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt" podStartSLOduration=1.5334850960000002 podStartE2EDuration="1.533485096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:15:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:15:21.532435442 +0000 UTC m=+2821.928666221" watchObservedRunningTime="2026-07-21 17:15:21.533485096 +0000 UTC m=+2821.929715886"
Jul 21 17:15:23.193246 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:23.193220    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rkgrw_9feaa7dd-98c6-430c-9baf-67c598074c1c/dns/0.log"
Jul 21 17:15:23.214187 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:23.214167    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rkgrw_9feaa7dd-98c6-430c-9baf-67c598074c1c/kube-rbac-proxy/0.log"
Jul 21 17:15:23.281860 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:23.281838    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sz6f7_dafdfbab-2e08-4ce4-bf0f-2efb77e9f40a/dns-node-resolver/0.log"
Jul 21 17:15:23.823907 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:23.823878    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68f6f659cb-b5g7v_543ee99f-0626-4462-912d-8d8e781ee332/registry/0.log"
Jul 21 17:15:23.892890 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:23.892866    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-slxwg_140d35fe-6c85-41d0-b3b4-4e44ebea0d80/node-ca/0.log"
Jul 21 17:15:24.877462 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:24.877433    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qdz2x_65804d3f-c34e-4152-92f8-523d3be0d7d0/istio-proxy/0.log"
Jul 21 17:15:25.046360 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:25.046334    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d77f95f8-6hhsz_f1dcecd2-3bd2-4287-a6ef-235681541284/kube-auth-proxy/0.log"
Jul 21 17:15:25.100703 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:25.100678    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hs8sg_0390849d-de27-4991-81bc-3d3156217d98/istio-proxy/0.log"
Jul 21 17:15:25.130938 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:25.130872    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hs8sg_0390849d-de27-4991-81bc-3d3156217d98/istio-proxy/1.log"
Jul 21 17:15:25.192403 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:25.192379    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-p62qp_ba91a689-60db-4bb1-b449-65df45c9d879/payload-processing/0.log"
Jul 21 17:15:25.952852 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:25.952822    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k8552_c9b0c197-d85d-4b81-8fdb-9c2fa1d808bc/serve-healthcheck-canary/0.log"
Jul 21 17:15:26.475611 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:26.475585    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bkwr_05e4d52b-67ba-453e-ad27-529cd7fe7a20/kube-rbac-proxy/0.log"
Jul 21 17:15:26.496083 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:26.496062    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bkwr_05e4d52b-67ba-453e-ad27-529cd7fe7a20/exporter/0.log"
Jul 21 17:15:26.520324 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:26.520306    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6bkwr_05e4d52b-67ba-453e-ad27-529cd7fe7a20/extractor/0.log"
Jul 21 17:15:27.532129 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:27.532103    2524 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nbkhg/perf-node-gather-daemonset-gjvgt"
Jul 21 17:15:28.903592 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:28.903562    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-svvfk_db6084af-9742-46a8-9e77-7e88980bf63a/manager/0.log"
Jul 21 17:15:29.068822 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:29.068796    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4wj94_85d31a95-be9f-4a27-9697-c8d8ba0adb09/manager/0.log"
Jul 21 17:15:29.192943 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:29.192882    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cqqhm_170a0bc5-278a-4cb7-bd6d-36e237d70a71/server/0.log"
Jul 21 17:15:29.259689 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:29.259668    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gps9z_8bd2cae8-19f9-4921-9d50-3227f565d372/manager/0.log"
Jul 21 17:15:29.282311 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:29.282297    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87c9445c4-g6msx_fe8262ab-56cd-4d51-88bf-2f04bbb934e9/manager/0.log"
Jul 21 17:15:29.303340 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:29.303324    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87c9445c4-g6msx_fe8262ab-56cd-4d51-88bf-2f04bbb934e9/copy-manifests/0.log"
Jul 21 17:15:30.939043 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:30.939017    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-nc5zn_5cc6e406-2264-489d-979f-b11fe1a3fa09/openshift-lws-operator/0.log"
Jul 21 17:15:31.297576 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:31.297547    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qdz2x_65804d3f-c34e-4152-92f8-523d3be0d7d0/istio-proxy/0.log"
Jul 21 17:15:31.457701 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:31.457676    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d77f95f8-6hhsz_f1dcecd2-3bd2-4287-a6ef-235681541284/kube-auth-proxy/0.log"
Jul 21 17:15:31.491379 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:31.491357    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hs8sg_0390849d-de27-4991-81bc-3d3156217d98/istio-proxy/0.log"
Jul 21 17:15:31.518113 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:31.518094    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hs8sg_0390849d-de27-4991-81bc-3d3156217d98/istio-proxy/1.log"
Jul 21 17:15:31.555686 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:31.555629    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-p62qp_ba91a689-60db-4bb1-b449-65df45c9d879/payload-processing/0.log"
Jul 21 17:15:32.863336 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:32.863256    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4qdz2x_65804d3f-c34e-4152-92f8-523d3be0d7d0/istio-proxy/0.log"
Jul 21 17:15:33.016013 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:33.015987    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d77f95f8-6hhsz_f1dcecd2-3bd2-4287-a6ef-235681541284/kube-auth-proxy/0.log"
Jul 21 17:15:33.056416 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:33.056393    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hs8sg_0390849d-de27-4991-81bc-3d3156217d98/istio-proxy/0.log"
Jul 21 17:15:33.081306 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:33.081288    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hs8sg_0390849d-de27-4991-81bc-3d3156217d98/istio-proxy/1.log"
Jul 21 17:15:33.125340 ip-10-0-135-103 kubenswrapper[2524]: I0721 17:15:33.125287    2524 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-p62qp_ba91a689-60db-4bb1-b449-65df45c9d879/payload-processing/0.log"