Jul 02 23:08:59.085744 ip-10-0-134-28 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 02 23:08:59.085752 ip-10-0-134-28 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 02 23:08:59.085759 ip-10-0-134-28 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 02 23:08:59.085986 ip-10-0-134-28 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 02 23:09:08.316611 ip-10-0-134-28 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 02 23:09:08.316627 ip-10-0-134-28 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 101151aae36d4201aacab0f4a03198c2 --
Jul 02 23:10:51.257221 ip-10-0-134-28 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 23:10:51.657303 ip-10-0-134-28 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:10:51.657303 ip-10-0-134-28 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 23:10:51.657303 ip-10-0-134-28 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:10:51.657303 ip-10-0-134-28 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 23:10:51.657303 ip-10-0-134-28 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:10:51.657303 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.631714    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 23:10:51.657303 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639628    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:51.657303 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639642    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:51.657303 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639645    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:51.657303 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639649    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:51.657303 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639652    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:51.657303 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639656    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:51.657303 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639659    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:51.657303 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639663    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639667    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639671    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639675    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639678    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639681    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639684    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639687    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639690    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639692    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639695    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639697    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639700    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639703    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639705    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639708    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639711    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639713    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639716    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639718    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:51.669726 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639722    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639725    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639727    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639730    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639732    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639739    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639742    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639744    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639747    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639751    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639754    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639756    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639759    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639761    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639764    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639766    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639769    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639772    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639774    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639777    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:51.670623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639780    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639782    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639785    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639787    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639790    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639792    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639794    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639797    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639799    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639802    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639804    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639806    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639809    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639812    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639814    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639817    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639819    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639822    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639825    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639828    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:51.671442 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639830    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639833    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639836    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639838    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639841    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639843    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639846    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639849    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639851    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639854    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639856    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639859    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639861    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639864    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639866    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639869    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639872    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639874    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639877    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639879    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:51.672091 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639881    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639884    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639886    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639888    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639891    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639895    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639898    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639901    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639904    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639907    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639910    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.639912    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640583    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640590    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640593    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640596    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640598    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640601    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640604    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:51.673199 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640606    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640609    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640611    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640614    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640617    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640619    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640622    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640624    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640626    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640629    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640632    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640634    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640637    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640639    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640641    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640644    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640647    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640649    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640651    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640654    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:51.675172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640669    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640672    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640675    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640678    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640680    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640683    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640686    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640688    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640691    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640694    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640696    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640701    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640704    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640707    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640710    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640714    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640717    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640719    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640722    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:51.676750 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640724    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640727    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640730    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640732    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640736    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640739    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640741    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640744    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640747    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640750    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640753    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640755    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640758    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640760    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640763    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640765    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640768    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640771    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640773    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640776    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:51.679012 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640778    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640780    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640783    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640791    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640796    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640799    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640802    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640804    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640807    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640811    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640815    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640818    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640821    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640823    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640826    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640829    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640831    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640835    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640838    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:51.681139 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640841    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640843    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640849    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640851    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640854    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640856    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640859    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640861    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640864    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640866    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640872    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640875    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640877    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.640880    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641254    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641261    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641264    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641267    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641270    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641272    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:51.682899 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641275    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641278    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641280    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641282    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641285    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641287    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641290    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641292    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641294    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641297    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641300    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641302    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641304    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641307    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641311    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641313    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641315    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641318    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641320    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:51.683612 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641323    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641326    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641328    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641332    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641335    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641337    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641340    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641342    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641345    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641347    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641349    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641352    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641354    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641357    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641359    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641361    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641364    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641368    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641371    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641375    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:51.685198 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641377    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641380    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641382    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641385    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641388    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641391    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641394    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641398    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641400    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641403    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641405    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641407    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641410    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641412    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641415    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641419    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641422    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641424    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641427    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641429    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:51.687055 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641432    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641434    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641437    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641439    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641442    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641445    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641448    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641450    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641453    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641455    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641458    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641460    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641463    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641465    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641469    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641472    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641474    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641478    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641480    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641485    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:51.688187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641487    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641490    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641492    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641494    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641497    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641499    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641502    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641506    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641509    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641511    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641514    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641516    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641519    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.641522    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641582    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641589    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641594    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641598    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641603    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641608    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641613    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 23:10:51.689589 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641619    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641624    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641628    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641633    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641637    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641639    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641642    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641645    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641648    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641652    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641656    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641661    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641664    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641667    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641670    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641673    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641677    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641680    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641684    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641687    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641690    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641693    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641696    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641699    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 23:10:51.690601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641702    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641706    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641708    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641711    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641714    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641717    2563 flags.go:64] FLAG: --enable-server="true"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641719    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641723    2563 flags.go:64] FLAG: --event-burst="100"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641726    2563 flags.go:64] FLAG: --event-qps="50"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641729    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641732    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641734    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641738    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641741    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641744    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641746    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641749    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641751    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641756    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641759    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641762    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641765    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641767    2563 flags.go:64] FLAG: --feature-gates=""
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641771    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641774    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 23:10:51.692452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641776    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641780    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641783    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641786    2563 flags.go:64] FLAG: --help="false"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641789    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-134-28.ec2.internal"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641792    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641794    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641797    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641800    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641804    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641806    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641809    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641812    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641814    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641817    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641820    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641823    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641825    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641828    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641831    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641833    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641836    2563 flags.go:64] FLAG: --lock-file=""
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641839    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641841    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 23:10:51.693279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641844    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641851    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641854    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641857    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641860    2563 flags.go:64] FLAG: --logging-format="text"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641862    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641865    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641868    2563 flags.go:64] FLAG: --manifest-url=""
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641871    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641876    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641879    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641883    2563 flags.go:64] FLAG: --max-pods="110"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641885    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641888    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641891    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641894    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641897    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641899    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641902    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641909    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641912    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641928    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641931    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 02 23:10:51.694068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641933    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641939    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641942    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641945    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641947    2563 flags.go:64] FLAG: --port="10250"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641950    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641953    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08c6fab81c12a4886"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641956    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641959    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641961    2563 flags.go:64] FLAG: --register-node="true"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641966    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641970    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641973    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641976    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641978    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641982    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641985    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641987    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641990    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641994    2563 flags.go:64] FLAG: --runonce="false"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.641997    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642000    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642003    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642005    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642008    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642011    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 23:10:51.694900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642014    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642017    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642019    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642022    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642025    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642027    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642030    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642033    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642035    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642040    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642043    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642045    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642050    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642052    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642055    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642058    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642062    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642065    2563 flags.go:64] FLAG: --v="2"
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642068    2563 flags.go:64] FLAG: --version="false"
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642072    2563 flags.go:64] FLAG: --vmodule=""
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642076    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642079    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642186    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642190    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:51.695747 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642194    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642198    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642201    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642203    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642206    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642208    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642211    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642214    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642216    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642218    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642221    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642223    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642226    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642228    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642231    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642233    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642236    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642238    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642241    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642244    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:51.696508 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642248    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642251    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642254    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642257    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642261    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642264    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642267    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642270    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642273    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642275    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642278    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642280    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642283    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642287    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642290    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642292    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642296    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642299    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642301    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:51.697240 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642304    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642306    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642309    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642311    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642314    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642316    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642319    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642321    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642324    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642326    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642328    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642331    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642333    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642336    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642338    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642340    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642343    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642346    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642349    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642351    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:51.697785 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642354    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642356    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642359    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642361    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642364    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642366    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642370    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642372    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642375    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642377    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642379    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642382    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642384    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642387    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642389    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642392    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642394    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642397    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642399    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:51.698489 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642403    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642406    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642409    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642412    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642415    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642417    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642420    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642423    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642425    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642428    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642432    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642435    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642438    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642440    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642443    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642446    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642449    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642452    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:51.699107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.642454    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:51.804171 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.642460    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:10:51.804171 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.649598    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 23:10:51.804171 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.649612    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 23:10:51.804171 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.649631    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 23:10:51.804171 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.649636    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 23:10:51.804171 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649687    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:51.804171 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649692    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:51.804171 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649696    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:51.804171 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649699    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:51.804171 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649702    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:51.804171 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649705    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:51.804171 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649708    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:51.804171 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649710    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:51.804171 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649713    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:51.804171 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649715    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:51.732482 ip-10-0-134-28 systemd[1]: Started Kubernetes Kubelet.
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649718    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649720    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649723    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649725    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649728    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649730    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649733    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649736    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649739    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649741    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649744    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649749    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649752    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649755    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649759    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649762    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649765    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649768    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:51.804823 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649771    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649773    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649776    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649778    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649781    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649783    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649785    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649788    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649791    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649793    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649796    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649798    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649801    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649803    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649806    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649808    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649811    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649816    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649818    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649821    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:51.805640 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649823    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649826    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649828    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649831    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649833    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649835    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649838    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649840    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649843    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649846    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649849    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649851    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649854    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649856    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649859    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649861    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649864    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649868    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649871    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649873    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:51.806278 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649876    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649878    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649881    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649883    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649886    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649888    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649890    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649893    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649895    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649899    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649901    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649904    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649907    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649910    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649927    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649931    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649935    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649938    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649941    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:51.807034 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649944    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:51.807631 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649946    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:51.807631 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649949    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:51.807631 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649953    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:51.807631 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649955    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:51.807631 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649958    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:51.807631 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649960    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:51.807631 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649963    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:51.807631 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649966    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:51.807631 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649968    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:51.807631 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649972    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:51.807631 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.649974    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:51.807631 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.649979    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:10:51.807631 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650075    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:10:51.807631 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650080    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:10:51.807631 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650083    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650086    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650088    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650091    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650093    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650096    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650098    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650102    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650104    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650107    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650109    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650112    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650114    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650117    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650119    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650122    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650125    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650127    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650130    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:10:51.808224 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650132    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650136    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650139    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650142    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650145    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650147    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650150    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650152    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650155    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650159    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650161    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650165    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650168    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650171    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650174    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650176    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650179    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650181    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650184    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:10:51.808839 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650186    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650190    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650192    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650194    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650197    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650199    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650202    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650204    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650207    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650210    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650212    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650215    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650218    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650220    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650223    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650225    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650228    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650231    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650234    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650237    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:10:51.809606 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650240    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650242    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650246    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650248    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650251    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650253    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650256    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650258    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650261    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650263    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650266    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650268    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650270    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650275    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650278    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650280    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650283    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650285    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650288    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650290    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:10:51.810253 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650293    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650295    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650298    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650300    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650303    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650306    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650308    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650310    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650313    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650315    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650318    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650320    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650323    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650325    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650329    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650331    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650334    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650336    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:10:51.810994 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:51.650339    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:10:51.811513 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.650343    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:10:51.811513 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.650424    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 23:10:51.811513 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.652569    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 23:10:51.811513 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.654025    2563 server.go:1019] "Starting client certificate rotation"
Jul 02 23:10:51.811513 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.654125    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 23:10:51.811513 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.654172    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 23:10:51.811513 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.657654    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 23:10:51.811513 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.661567    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 23:10:51.811513 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.677445    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 02 23:10:51.811513 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.679940    2563 log.go:25] "Validated CRI v1 image API"
Jul 02 23:10:51.811513 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.681756    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 23:10:51.811513 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.684965    2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 d7fbe7a3-56bc-42f4-84ed-312bdaff1def:/dev/nvme0n1p4 f87f83a4-cd00-4f21-8ca6-d300d8a053bb:/dev/nvme0n1p3]
Jul 02 23:10:51.971344 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.684979    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 23:10:51.999091 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.693901    2563 manager.go:216] Machine: {Timestamp:2026-07-02 23:10:51.689516569 +0000 UTC m=+0.313934936 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199171 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2949a71780b82c33b9ac5f39f31848 SystemUUID:ec2949a7-1780-b82c-33b9-ac5f39f31848 BootID:101151aa-e36d-4201-aaca-b0f4a03198c2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a1:7a:51:c1:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a1:7a:51:c1:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:f2:01:1b:be:e3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 23:10:51.999091 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.694077    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 23:10:51.999091 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.694209    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 23:10:51.999091 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.696154    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 23:10:51.999091 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.697883    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 23:10:51.999091 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.697933    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-28.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 23:10:51.999091 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.698756    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.698772    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.698788    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.699436    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.706143    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.715928    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.716027    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.716055    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.716064    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.716079    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.716088    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.716104    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.716377    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.716392    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.718661    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.720952    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.720986    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.722199    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.722212    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.722218    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.722223    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.722231    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.722237    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.722245    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.722249    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.722256    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.722262    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.722275    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.722280    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.722875    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.722883    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.727486    2563 server.go:1268] "Started kubelet"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.727559    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.727567    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.727660    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.733183    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-28.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:51.733285    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.733431    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hjrfg"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:51.733584    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.734022    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 23:10:51.999745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.734335    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:51.736789    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:51.736370    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-28.ec2.internal.18be9bd75ab63148  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-28.ec2.internal,UID:ip-10-0-134-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-28.ec2.internal,},FirstTimestamp:2026-07-02 23:10:51.727458632 +0000 UTC m=+0.351876998,LastTimestamp:2026-07-02 23:10:51.727458632 +0000 UTC m=+0.351876998,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-28.ec2.internal,}"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.739910    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hjrfg"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.748688    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.748707    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:51.748787    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.749416    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.749431    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.749532    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.749539    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.749737    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.749749    2563 factory.go:55] Registering systemd factory
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.749756    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.749975    2563 factory.go:153] Registering CRI-O factory
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.749991    2563 factory.go:223] Registration of the crio container factory successfully
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.750023    2563 factory.go:103] Registering Raw factory
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.750043    2563 manager.go:1196] Started watching for new ooms in manager
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.750299    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.750406    2563 manager.go:349] Starting recovery of all containers
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.756543    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:51.760251    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:51.760417    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.763148    2563 manager.go:354] Recovery completed
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.767403    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.769351    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.769373    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.769382    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.769747    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.769758    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.769774    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.769803    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.770434    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:52.003873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.770450    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.770462    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.772185    2563 policy_none.go:49] "None policy: Start"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.772197    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.772206    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.774085    2563 policy_none.go:47] "Start"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.815063    2563 manager.go:337] "Starting Device Plugin manager"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:51.815214    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.815226    2563 server.go:87] "Starting device plugin registration server"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.815438    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.815449    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.815562    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.815625    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.815633    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:51.816091    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:51.816131    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-28.ec2.internal\" not found"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.879398    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.879431    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.879450    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:51.879477    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.881668    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.916531    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.917269    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.917298    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.917310    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.917330    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.924951    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:51.924969    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-28.ec2.internal\": node \"ip-10-0-134-28.ec2.internal\" not found"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:51.958116    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.980399    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal"]
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.980457    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.981220    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.981241    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.981254    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.983566    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.983666    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.983689    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.984219    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:52.005777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.984235    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:52.006827 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.984259    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:52.006827 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.984270    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:52.006827 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.984242    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:52.006827 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.984321    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:52.006827 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.986502    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.006827 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.986527    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:10:52.006827 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.987354    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:10:52.006827 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.987374    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:10:52.006827 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:51.987383    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:10:52.149010 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:52.011460    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-28.ec2.internal\" not found" node="ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.149010 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:52.014511    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-28.ec2.internal\" not found" node="ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.149010 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:52.058501    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found"
Jul 02 23:10:52.151206 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.150807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ebdc0778a9b8333df9269cbb287fc804-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal\" (UID: \"ebdc0778a9b8333df9269cbb287fc804\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.151206 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.150827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebdc0778a9b8333df9269cbb287fc804-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal\" (UID: \"ebdc0778a9b8333df9269cbb287fc804\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.151206 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.150849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64a5aa117e63441d09828f87cebc30e8-config\") pod \"kube-apiserver-proxy-ip-10-0-134-28.ec2.internal\" (UID: \"64a5aa117e63441d09828f87cebc30e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.244858 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:52.158948    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found"
Jul 02 23:10:52.359333 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.251410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ebdc0778a9b8333df9269cbb287fc804-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal\" (UID: \"ebdc0778a9b8333df9269cbb287fc804\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.359333 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.251434    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebdc0778a9b8333df9269cbb287fc804-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal\" (UID: \"ebdc0778a9b8333df9269cbb287fc804\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.359333 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.251457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64a5aa117e63441d09828f87cebc30e8-config\") pod \"kube-apiserver-proxy-ip-10-0-134-28.ec2.internal\" (UID: \"64a5aa117e63441d09828f87cebc30e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.359333 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.251494    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/64a5aa117e63441d09828f87cebc30e8-config\") pod \"kube-apiserver-proxy-ip-10-0-134-28.ec2.internal\" (UID: \"64a5aa117e63441d09828f87cebc30e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.359333 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.251503    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ebdc0778a9b8333df9269cbb287fc804-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal\" (UID: \"ebdc0778a9b8333df9269cbb287fc804\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.359333 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.251538    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebdc0778a9b8333df9269cbb287fc804-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal\" (UID: \"ebdc0778a9b8333df9269cbb287fc804\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.359333 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:52.259520    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found"
Jul 02 23:10:52.361638 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:52.360339    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found"
Jul 02 23:10:52.444270 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.444247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.444392 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.444375    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.461017 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:52.460970    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found"
Jul 02 23:10:52.561279 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:52.561217    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found"
Jul 02 23:10:52.653421 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.653397    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 23:10:52.653562 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.653544    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 23:10:52.661999 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:52.661984    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found"
Jul 02 23:10:52.758976 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.758947    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 23:05:52 +0000 UTC" deadline="2027-12-04 13:15:31.689849794 +0000 UTC"
Jul 02 23:10:52.758976 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.758971    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12470h4m38.930881638s"
Jul 02 23:10:52.762803 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:52.762784    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found"
Jul 02 23:10:52.862987 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:52.862961    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-28.ec2.internal\" not found"
Jul 02 23:10:52.896043 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.896015    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:52.949111 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.949083    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.965288 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.965260    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 23:10:52.967390 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.967369    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal"
Jul 02 23:10:52.968966 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.968945    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:52.978667 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.978651    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 23:10:52.984862 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:52.984845    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:53.061309 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:53.061275    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebdc0778a9b8333df9269cbb287fc804.slice/crio-2ac6e74be9306fcbc920f4e6f1d07ce91c0644286fc0e8ac63671efef1a02e66 WatchSource:0}: Error finding container 2ac6e74be9306fcbc920f4e6f1d07ce91c0644286fc0e8ac63671efef1a02e66: Status 404 returned error can't find the container with id 2ac6e74be9306fcbc920f4e6f1d07ce91c0644286fc0e8ac63671efef1a02e66
Jul 02 23:10:53.071485 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.071461    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:10:53.076206 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:10:53.076183    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a5aa117e63441d09828f87cebc30e8.slice/crio-9999790f791085c543b92dfd04e8403cac0e75232cc9b53c93861795de50440d WatchSource:0}: Error finding container 9999790f791085c543b92dfd04e8403cac0e75232cc9b53c93861795de50440d: Status 404 returned error can't find the container with id 9999790f791085c543b92dfd04e8403cac0e75232cc9b53c93861795de50440d
Jul 02 23:10:53.717152 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.717112    2563 apiserver.go:52] "Watching apiserver"
Jul 02 23:10:53.729349 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.729321    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 23:10:53.731206 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.731177    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-stw2z","openshift-ovn-kubernetes/ovnkube-node-4gkxz","kube-system/global-pull-secret-syncer-fjtpp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw","openshift-cluster-node-tuning-operator/tuned-qhfwf","openshift-image-registry/node-ca-v69lx","openshift-multus/multus-additional-cni-plugins-mmpkm","openshift-multus/multus-drz79","openshift-network-diagnostics/network-check-target-46nf6","openshift-network-operator/iptables-alerter-t4qmv","kube-system/konnectivity-agent-pzkxh","kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal","openshift-dns/node-resolver-48c2d","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal"]
Jul 02 23:10:53.733976 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.733948    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:10:53.734073 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:53.734032    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:10:53.736421 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.736401    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.739317 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.739271    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-48c2d"
Jul 02 23:10:53.740788 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.740304    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n9hnj\""
Jul 02 23:10:53.740788 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.740499    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 23:10:53.741339 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.741321    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pzkxh"
Jul 02 23:10:53.742535 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.741942    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 23:10:53.742535 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.741990    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 23:10:53.742535 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.742126    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 23:10:53.742535 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.742234    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 23:10:53.742535 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.742403    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 23:10:53.743464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.743239    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 23:10:53.743464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.743261    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 23:10:53.743614 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.743582    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4v6fh\""
Jul 02 23:10:53.744121 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.744027    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.744477 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.744459    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 23:10:53.744875 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.744854    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 23:10:53.745089 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.745072    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fpnsn\""
Jul 02 23:10:53.747233 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.747213    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 23:10:53.747463 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.747434    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 23:10:53.747463 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.747445    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 23:10:53.747760 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.747708    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 23:10:53.747760 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.747738    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 23:10:53.747873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.747855    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s46rg\""
Jul 02 23:10:53.748033 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.748016    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v69lx"
Jul 02 23:10:53.750179 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.750158    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 23:10:53.754102 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.753784    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 23:10:53.754102 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.754017    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w4clk\""
Jul 02 23:10:53.754258 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.754156    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.754338 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.754321    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 23:10:53.754462 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.754400    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 23:10:53.756273 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.754755    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.757991 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.757953    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:10:53.758115 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:53.758079    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:10:53.760137 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.760119    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t4qmv"
Jul 02 23:10:53.762598 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.762575    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 23:10:53.762866 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.762845    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r6spk\""
Jul 02 23:10:53.763100 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.763082    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.763625 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.763603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab285b66-20ac-4558-9ed4-900dd2e75ec3-cnibin\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.763711 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.763642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab285b66-20ac-4558-9ed4-900dd2e75ec3-cni-binary-copy\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.763711 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.763670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72acfc32-5be2-42a3-84e9-ec05bde76f43-cni-binary-copy\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.763711 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.763703    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-run-systemd\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.763871 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.763745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-log-socket\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.763871 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.763771    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-sys\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.763871 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.763795    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-hostroot\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.763871 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.763822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-etc-openvswitch\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.763871 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.763848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.764143 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.763872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-cni-netd\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.764143 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.763894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-env-overrides\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.764143 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.763919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-sysctl-d\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.764143 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.763943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-var-lib-kubelet\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.764143 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.763967    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab285b66-20ac-4558-9ed4-900dd2e75ec3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.764143 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764105    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a588334-ee3c-4a30-a704-5e42f0dfae27-host\") pod \"node-ca-v69lx\" (UID: \"2a588334-ee3c-4a30-a704-5e42f0dfae27\") " pod="openshift-image-registry/node-ca-v69lx"
Jul 02 23:10:53.764143 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-kubelet\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.764484 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764165    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sjzv\" (UniqueName: \"kubernetes.io/projected/98d4d36e-f535-4b18-bec3-f6e8057253c4-kube-api-access-4sjzv\") pod \"node-resolver-48c2d\" (UID: \"98d4d36e-f535-4b18-bec3-f6e8057253c4\") " pod="openshift-dns/node-resolver-48c2d"
Jul 02 23:10:53.764484 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t864f\" (UniqueName: \"kubernetes.io/projected/ab285b66-20ac-4558-9ed4-900dd2e75ec3-kube-api-access-t864f\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.764484 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49l4g\" (UniqueName: \"kubernetes.io/projected/2a588334-ee3c-4a30-a704-5e42f0dfae27-kube-api-access-49l4g\") pod \"node-ca-v69lx\" (UID: \"2a588334-ee3c-4a30-a704-5e42f0dfae27\") " pod="openshift-image-registry/node-ca-v69lx"
Jul 02 23:10:53.764484 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764250    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-cnibin\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.764484 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764272    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-node-log\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.764484 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764296    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-ovn-node-metrics-cert\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.764484 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/98d4d36e-f535-4b18-bec3-f6e8057253c4-hosts-file\") pod \"node-resolver-48c2d\" (UID: \"98d4d36e-f535-4b18-bec3-f6e8057253c4\") " pod="openshift-dns/node-resolver-48c2d"
Jul 02 23:10:53.764484 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-var-lib-cni-multus\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.764484 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-var-lib-kubelet\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.764484 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764412    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-var-lib-openvswitch\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.764484 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-run\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.764484 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab285b66-20ac-4558-9ed4-900dd2e75ec3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.765135 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-cni-bin\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.765135 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-sysconfig\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.765135 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-tuned\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.765135 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03629f7d-15f4-4e0c-931c-fbcb131fa7c3-agent-certs\") pod \"konnectivity-agent-pzkxh\" (UID: \"03629f7d-15f4-4e0c-931c-fbcb131fa7c3\") " pod="kube-system/konnectivity-agent-pzkxh"
Jul 02 23:10:53.765135 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab285b66-20ac-4558-9ed4-900dd2e75ec3-system-cni-dir\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.765135 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-system-cni-dir\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.765135 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764660    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-multus-cni-dir\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.765135 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hssf5\" (UniqueName: \"kubernetes.io/projected/72acfc32-5be2-42a3-84e9-ec05bde76f43-kube-api-access-hssf5\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.765135 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-sysctl-conf\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.765135 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764735    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs\") pod \"network-metrics-daemon-stw2z\" (UID: \"b67810dc-1b52-4571-8430-9e1eb815d6e8\") " pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:10:53.765135 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-multus-conf-dir\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.765135 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-run-ovn\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.765135 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764817    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-ovnkube-script-lib\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.765135 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l75xm\" (UniqueName: \"kubernetes.io/projected/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-kube-api-access-l75xm\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.765808 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764874    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab285b66-20ac-4558-9ed4-900dd2e75ec3-os-release\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.765808 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-os-release\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.765808 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-modprobe-d\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.765808 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-kubernetes\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.765808 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.764971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-multus-socket-dir-parent\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.765808 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.765017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-run-netns\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.765808 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.765043    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/72acfc32-5be2-42a3-84e9-ec05bde76f43-multus-daemon-config\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.765808 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.765067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-run-netns\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.765808 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.765274    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:10:53.765808 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:53.765330    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:10:53.766537 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.766514    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 23:10:53.766619 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.766564    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 23:10:53.766676 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.766666    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:10:53.766862 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.766842    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:10:53.766977 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.766950    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h5ttn\""
Jul 02 23:10:53.767177 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767156    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tscx7\""
Jul 02 23:10:53.767346 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767330    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 23:10:53.767418 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-run-k8s-cni-cncf-io\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.767476 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-run-multus-certs\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.767476 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767446    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-slash\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.767476 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767471    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-systemd\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.767628 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767571    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-lib-modules\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.767628 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-var-lib-cni-bin\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.767733 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-run-openvswitch\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.767733 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-ovnkube-config\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.767733 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767687    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88pk8\" (UniqueName: \"kubernetes.io/projected/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-kube-api-access-88pk8\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.767733 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767709    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-host\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.767733 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767732    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03629f7d-15f4-4e0c-931c-fbcb131fa7c3-konnectivity-ca\") pod \"konnectivity-agent-pzkxh\" (UID: \"03629f7d-15f4-4e0c-931c-fbcb131fa7c3\") " pod="kube-system/konnectivity-agent-pzkxh"
Jul 02 23:10:53.767982 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-systemd-units\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.767982 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.767982 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98d4d36e-f535-4b18-bec3-f6e8057253c4-tmp-dir\") pod \"node-resolver-48c2d\" (UID: \"98d4d36e-f535-4b18-bec3-f6e8057253c4\") " pod="openshift-dns/node-resolver-48c2d"
Jul 02 23:10:53.767982 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sswqr\" (UniqueName: \"kubernetes.io/projected/b67810dc-1b52-4571-8430-9e1eb815d6e8-kube-api-access-sswqr\") pod \"network-metrics-daemon-stw2z\" (UID: \"b67810dc-1b52-4571-8430-9e1eb815d6e8\") " pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:10:53.767982 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767866    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab285b66-20ac-4558-9ed4-900dd2e75ec3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.767982 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a588334-ee3c-4a30-a704-5e42f0dfae27-serviceca\") pod \"node-ca-v69lx\" (UID: \"2a588334-ee3c-4a30-a704-5e42f0dfae27\") " pod="openshift-image-registry/node-ca-v69lx"
Jul 02 23:10:53.767982 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767909    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-etc-kubernetes\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.767982 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.767929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-tmp\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.770672 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.770570    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 23:10:53.770776 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.770752    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 23:10:53.772705 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.772551    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 23:10:53.772705 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.772579    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8m6js\""
Jul 02 23:10:53.780461 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.780438    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 23:10:53.812488 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.812469    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:10:53.851895 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.851850    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 23:10:53.853482 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.853342    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wvn79"
Jul 02 23:10:53.862592 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.862560    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wvn79"
Jul 02 23:10:53.868644 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.868621    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-device-dir\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.868746 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.868663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sjzv\" (UniqueName: \"kubernetes.io/projected/98d4d36e-f535-4b18-bec3-f6e8057253c4-kube-api-access-4sjzv\") pod \"node-resolver-48c2d\" (UID: \"98d4d36e-f535-4b18-bec3-f6e8057253c4\") " pod="openshift-dns/node-resolver-48c2d"
Jul 02 23:10:53.868746 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.868690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t864f\" (UniqueName: \"kubernetes.io/projected/ab285b66-20ac-4558-9ed4-900dd2e75ec3-kube-api-access-t864f\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.868746 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.868720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49l4g\" (UniqueName: \"kubernetes.io/projected/2a588334-ee3c-4a30-a704-5e42f0dfae27-kube-api-access-49l4g\") pod \"node-ca-v69lx\" (UID: \"2a588334-ee3c-4a30-a704-5e42f0dfae27\") " pod="openshift-image-registry/node-ca-v69lx"
Jul 02 23:10:53.868915 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.868745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-cnibin\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.868915 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.868770    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-node-log\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.868915 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.868794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-ovn-node-metrics-cert\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.868915 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.868818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/98d4d36e-f535-4b18-bec3-f6e8057253c4-hosts-file\") pod \"node-resolver-48c2d\" (UID: \"98d4d36e-f535-4b18-bec3-f6e8057253c4\") " pod="openshift-dns/node-resolver-48c2d"
Jul 02 23:10:53.868915 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.868842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-var-lib-cni-multus\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.868915 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.868866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-var-lib-kubelet\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.868915 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.868891    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-var-lib-openvswitch\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.868915 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.868912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-run\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.869358 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.868934    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab285b66-20ac-4558-9ed4-900dd2e75ec3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.869358 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.868978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-cni-bin\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.869358 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-sysconfig\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.869358 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-tuned\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.869358 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03629f7d-15f4-4e0c-931c-fbcb131fa7c3-agent-certs\") pod \"konnectivity-agent-pzkxh\" (UID: \"03629f7d-15f4-4e0c-931c-fbcb131fa7c3\") " pod="kube-system/konnectivity-agent-pzkxh"
Jul 02 23:10:53.869358 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869072    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab285b66-20ac-4558-9ed4-900dd2e75ec3-system-cni-dir\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.869358 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-system-cni-dir\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.869358 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869122    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-multus-cni-dir\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.869358 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hssf5\" (UniqueName: \"kubernetes.io/projected/72acfc32-5be2-42a3-84e9-ec05bde76f43-kube-api-access-hssf5\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.869358 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-sysctl-conf\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.869358 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs\") pod \"network-metrics-daemon-stw2z\" (UID: \"b67810dc-1b52-4571-8430-9e1eb815d6e8\") " pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:10:53.869358 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-multus-conf-dir\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.869358 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-run-ovn\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.869358 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-ovnkube-script-lib\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.870077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l75xm\" (UniqueName: \"kubernetes.io/projected/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-kube-api-access-l75xm\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.870077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869352    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.870077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-sys-fs\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.870077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869439    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdj4v\" (UniqueName: \"kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v\") pod \"network-check-target-46nf6\" (UID: \"82141c32-ce33-4ece-b8af-7a5d455883a6\") " pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:10:53.870077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869450    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-cni-bin\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.870077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab285b66-20ac-4558-9ed4-900dd2e75ec3-os-release\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.870077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-os-release\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.870077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.869772    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab285b66-20ac-4558-9ed4-900dd2e75ec3-os-release\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.870481 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870242    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-modprobe-d\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.870481 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870285    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-kubernetes\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.870481 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870325    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-etc-selinux\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.870481 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870355    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-multus-socket-dir-parent\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.870481 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870379    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-run-netns\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.870481 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/72acfc32-5be2-42a3-84e9-ec05bde76f43-multus-daemon-config\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.870481 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-run-netns\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.870481 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-run-k8s-cni-cncf-io\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.870860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-run-multus-certs\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.870860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870513    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-slash\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.870860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870540    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-systemd\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.870860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-lib-modules\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.870860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870588    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/904dd94e-b420-4d10-a889-3dd86aecf071-kubelet-config\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:10:53.870860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/904dd94e-b420-4d10-a889-3dd86aecf071-dbus\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:10:53.870860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-var-lib-cni-bin\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.870860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-run-openvswitch\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.870860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-ovnkube-config\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.870860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88pk8\" (UniqueName: \"kubernetes.io/projected/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-kube-api-access-88pk8\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.870860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-host\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.870860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-registration-dir\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.870860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870825    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03629f7d-15f4-4e0c-931c-fbcb131fa7c3-konnectivity-ca\") pod \"konnectivity-agent-pzkxh\" (UID: \"03629f7d-15f4-4e0c-931c-fbcb131fa7c3\") " pod="kube-system/konnectivity-agent-pzkxh"
Jul 02 23:10:53.870860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-systemd-units\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.871553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.870885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.871553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98d4d36e-f535-4b18-bec3-f6e8057253c4-tmp-dir\") pod \"node-resolver-48c2d\" (UID: \"98d4d36e-f535-4b18-bec3-f6e8057253c4\") " pod="openshift-dns/node-resolver-48c2d"
Jul 02 23:10:53.871553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sswqr\" (UniqueName: \"kubernetes.io/projected/b67810dc-1b52-4571-8430-9e1eb815d6e8-kube-api-access-sswqr\") pod \"network-metrics-daemon-stw2z\" (UID: \"b67810dc-1b52-4571-8430-9e1eb815d6e8\") " pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:10:53.871553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871212    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/10e828d5-2741-4f32-806d-854d32cb5edb-iptables-alerter-script\") pod \"iptables-alerter-t4qmv\" (UID: \"10e828d5-2741-4f32-806d-854d32cb5edb\") " pod="openshift-network-operator/iptables-alerter-t4qmv"
Jul 02 23:10:53.871553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10e828d5-2741-4f32-806d-854d32cb5edb-host-slash\") pod \"iptables-alerter-t4qmv\" (UID: \"10e828d5-2741-4f32-806d-854d32cb5edb\") " pod="openshift-network-operator/iptables-alerter-t4qmv"
Jul 02 23:10:53.871553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnd8p\" (UniqueName: \"kubernetes.io/projected/10e828d5-2741-4f32-806d-854d32cb5edb-kube-api-access-xnd8p\") pod \"iptables-alerter-t4qmv\" (UID: \"10e828d5-2741-4f32-806d-854d32cb5edb\") " pod="openshift-network-operator/iptables-alerter-t4qmv"
Jul 02 23:10:53.871553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab285b66-20ac-4558-9ed4-900dd2e75ec3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.871553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871320    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a588334-ee3c-4a30-a704-5e42f0dfae27-serviceca\") pod \"node-ca-v69lx\" (UID: \"2a588334-ee3c-4a30-a704-5e42f0dfae27\") " pod="openshift-image-registry/node-ca-v69lx"
Jul 02 23:10:53.871553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-etc-kubernetes\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.871553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-tmp\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.871553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwvq6\" (UniqueName: \"kubernetes.io/projected/ebc843ff-e182-49bf-9134-222d3bc90041-kube-api-access-kwvq6\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.871553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab285b66-20ac-4558-9ed4-900dd2e75ec3-cnibin\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.871553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871485    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab285b66-20ac-4558-9ed4-900dd2e75ec3-cni-binary-copy\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.871553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72acfc32-5be2-42a3-84e9-ec05bde76f43-cni-binary-copy\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.872288 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-run-systemd\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.872288 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-log-socket\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.872288 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871587    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-multus-socket-dir-parent\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.872288 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-sys\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.872288 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:10:53.872288 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:53.871852    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:53.872288 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871886    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-systemd-units\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.872288 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:53.871922    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs podName:b67810dc-1b52-4571-8430-9e1eb815d6e8 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:54.371900191 +0000 UTC m=+2.996318572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs") pod "network-metrics-daemon-stw2z" (UID: "b67810dc-1b52-4571-8430-9e1eb815d6e8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:53.872288 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.871921    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-lib-modules\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.872288 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.872188    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab285b66-20ac-4558-9ed4-900dd2e75ec3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.872288 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.872258    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-sysctl-conf\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.872288 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.872264    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98d4d36e-f535-4b18-bec3-f6e8057253c4-tmp-dir\") pod \"node-resolver-48c2d\" (UID: \"98d4d36e-f535-4b18-bec3-f6e8057253c4\") " pod="openshift-dns/node-resolver-48c2d"
Jul 02 23:10:53.872859 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.872314    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-hostroot\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.872859 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.872339    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-multus-conf-dir\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.872859 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.872374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-etc-openvswitch\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.872859 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.872788    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.873096 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.873063    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-etc-openvswitch\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.873882 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.873390    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 23:10:53.873882 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.873464    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-run-ovn\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.873882 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.873605    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-hostroot\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.873882 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.873625    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab285b66-20ac-4558-9ed4-900dd2e75ec3-cnibin\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.873882 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.873660    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab285b66-20ac-4558-9ed4-900dd2e75ec3-cni-binary-copy\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.873882 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.873679    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-run\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.873882 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.873766    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-kubernetes\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.873882 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.873818    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-modprobe-d\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.874384 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.873942    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72acfc32-5be2-42a3-84e9-ec05bde76f43-cni-binary-copy\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.874384 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.872390    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03629f7d-15f4-4e0c-931c-fbcb131fa7c3-konnectivity-ca\") pod \"konnectivity-agent-pzkxh\" (UID: \"03629f7d-15f4-4e0c-931c-fbcb131fa7c3\") " pod="kube-system/konnectivity-agent-pzkxh"
Jul 02 23:10:53.874384 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.872434    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-etc-kubernetes\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.874384 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.874046    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.874384 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.874096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-cni-netd\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.874384 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.874131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-env-overrides\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.874384 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.874166    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-sysctl-d\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.874384 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.874221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-var-lib-kubelet\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.874384 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.874259    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-socket-dir\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.874384 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.874247    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab285b66-20ac-4558-9ed4-900dd2e75ec3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.874832 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.874421    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/98d4d36e-f535-4b18-bec3-f6e8057253c4-hosts-file\") pod \"node-resolver-48c2d\" (UID: \"98d4d36e-f535-4b18-bec3-f6e8057253c4\") " pod="openshift-dns/node-resolver-48c2d"
Jul 02 23:10:53.874832 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.874439    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2a588334-ee3c-4a30-a704-5e42f0dfae27-serviceca\") pod \"node-ca-v69lx\" (UID: \"2a588334-ee3c-4a30-a704-5e42f0dfae27\") " pod="openshift-image-registry/node-ca-v69lx"
Jul 02 23:10:53.874832 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.874479    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-run-ovn-kubernetes\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.874832 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.874563    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-os-release\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.874832 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.874718    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-system-cni-dir\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.874832 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.874732    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-sys\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.875564 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.875536    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-ovnkube-script-lib\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.875752 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.875689    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-sysconfig\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.875752 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.875745    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-cnibin\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.875932 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.875787    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-node-log\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.876953 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.876799    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-var-lib-cni-multus\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.877625 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.877203    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-var-lib-kubelet\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.877625 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.877274    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-var-lib-openvswitch\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.877625 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.877317    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab285b66-20ac-4558-9ed4-900dd2e75ec3-system-cni-dir\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.877625 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.877356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab285b66-20ac-4558-9ed4-900dd2e75ec3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.877625 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.877478    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-multus-cni-dir\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.877625 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.877545    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-run-systemd\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.878054 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.877621    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-run-k8s-cni-cncf-io\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.878054 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.877657    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-run-netns\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.878054 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.877734    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-host\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.878054 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.877797    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-var-lib-cni-bin\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.878246 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.878233    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/72acfc32-5be2-42a3-84e9-ec05bde76f43-host-run-multus-certs\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.878343 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.878320    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-run-openvswitch\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.878608 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.878570    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-systemd\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.879294 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.878731    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-run-netns\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.879294 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.878784    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-slash\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.879294 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.878885    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-ovnkube-config\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.879294 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.878902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a588334-ee3c-4a30-a704-5e42f0dfae27-host\") pod \"node-ca-v69lx\" (UID: \"2a588334-ee3c-4a30-a704-5e42f0dfae27\") " pod="openshift-image-registry/node-ca-v69lx"
Jul 02 23:10:53.879294 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.878915    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-cni-netd\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.879294 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.878951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-kubelet\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.879294 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.879080    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/72acfc32-5be2-42a3-84e9-ec05bde76f43-multus-daemon-config\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.879294 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.879098    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-var-lib-kubelet\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.879294 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.879113    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-sysctl-d\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.879294 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.879142    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-log-socket\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.879294 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.879193    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-host-kubelet\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.879294 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.879256    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a588334-ee3c-4a30-a704-5e42f0dfae27-host\") pod \"node-ca-v69lx\" (UID: \"2a588334-ee3c-4a30-a704-5e42f0dfae27\") " pod="openshift-image-registry/node-ca-v69lx"
Jul 02 23:10:53.879294 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.879435    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-env-overrides\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.882020 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.881326    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab285b66-20ac-4558-9ed4-900dd2e75ec3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.882020 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.881340    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03629f7d-15f4-4e0c-931c-fbcb131fa7c3-agent-certs\") pod \"konnectivity-agent-pzkxh\" (UID: \"03629f7d-15f4-4e0c-931c-fbcb131fa7c3\") " pod="kube-system/konnectivity-agent-pzkxh"
Jul 02 23:10:53.883751 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.883534    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-tmp\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.883864 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.883766    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-etc-tuned\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.885565 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.885227    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t864f\" (UniqueName: \"kubernetes.io/projected/ab285b66-20ac-4558-9ed4-900dd2e75ec3-kube-api-access-t864f\") pod \"multus-additional-cni-plugins-mmpkm\" (UID: \"ab285b66-20ac-4558-9ed4-900dd2e75ec3\") " pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:53.885565 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.885344    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-ovn-node-metrics-cert\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.885565 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.885556    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sjzv\" (UniqueName: \"kubernetes.io/projected/98d4d36e-f535-4b18-bec3-f6e8057253c4-kube-api-access-4sjzv\") pod \"node-resolver-48c2d\" (UID: \"98d4d36e-f535-4b18-bec3-f6e8057253c4\") " pod="openshift-dns/node-resolver-48c2d"
Jul 02 23:10:53.887435 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.887383    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal" event={"ID":"64a5aa117e63441d09828f87cebc30e8","Type":"ContainerStarted","Data":"9999790f791085c543b92dfd04e8403cac0e75232cc9b53c93861795de50440d"}
Jul 02 23:10:53.889050 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.888979    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l75xm\" (UniqueName: \"kubernetes.io/projected/1ef5829b-63d7-4915-8269-5f2b46c6b2b1-kube-api-access-l75xm\") pod \"tuned-qhfwf\" (UID: \"1ef5829b-63d7-4915-8269-5f2b46c6b2b1\") " pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:53.889189 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.889089    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49l4g\" (UniqueName: \"kubernetes.io/projected/2a588334-ee3c-4a30-a704-5e42f0dfae27-kube-api-access-49l4g\") pod \"node-ca-v69lx\" (UID: \"2a588334-ee3c-4a30-a704-5e42f0dfae27\") " pod="openshift-image-registry/node-ca-v69lx"
Jul 02 23:10:53.889455 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.889414    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88pk8\" (UniqueName: \"kubernetes.io/projected/e54353ae-f9fa-42c5-aa16-76e35ccb54f6-kube-api-access-88pk8\") pod \"ovnkube-node-4gkxz\" (UID: \"e54353ae-f9fa-42c5-aa16-76e35ccb54f6\") " pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:53.889763 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.889731    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" event={"ID":"ebdc0778a9b8333df9269cbb287fc804","Type":"ContainerStarted","Data":"2ac6e74be9306fcbc920f4e6f1d07ce91c0644286fc0e8ac63671efef1a02e66"}
Jul 02 23:10:53.890180 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.890158    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hssf5\" (UniqueName: \"kubernetes.io/projected/72acfc32-5be2-42a3-84e9-ec05bde76f43-kube-api-access-hssf5\") pod \"multus-drz79\" (UID: \"72acfc32-5be2-42a3-84e9-ec05bde76f43\") " pod="openshift-multus/multus-drz79"
Jul 02 23:10:53.891053 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.891030    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sswqr\" (UniqueName: \"kubernetes.io/projected/b67810dc-1b52-4571-8430-9e1eb815d6e8-kube-api-access-sswqr\") pod \"network-metrics-daemon-stw2z\" (UID: \"b67810dc-1b52-4571-8430-9e1eb815d6e8\") " pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:10:53.979557 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.979490    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.979557 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.979531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-sys-fs\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.979714 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.979557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdj4v\" (UniqueName: \"kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v\") pod \"network-check-target-46nf6\" (UID: \"82141c32-ce33-4ece-b8af-7a5d455883a6\") " pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:10:53.979714 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.979587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-etc-selinux\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.979714 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.979627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/904dd94e-b420-4d10-a889-3dd86aecf071-kubelet-config\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:10:53.979714 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.979650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/904dd94e-b420-4d10-a889-3dd86aecf071-dbus\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:10:53.979714 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.979678    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-registration-dir\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.979714 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.979705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/10e828d5-2741-4f32-806d-854d32cb5edb-iptables-alerter-script\") pod \"iptables-alerter-t4qmv\" (UID: \"10e828d5-2741-4f32-806d-854d32cb5edb\") " pod="openshift-network-operator/iptables-alerter-t4qmv"
Jul 02 23:10:53.980008 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.979832    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-etc-selinux\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.980008 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.979874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10e828d5-2741-4f32-806d-854d32cb5edb-host-slash\") pod \"iptables-alerter-t4qmv\" (UID: \"10e828d5-2741-4f32-806d-854d32cb5edb\") " pod="openshift-network-operator/iptables-alerter-t4qmv"
Jul 02 23:10:53.980008 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.979902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnd8p\" (UniqueName: \"kubernetes.io/projected/10e828d5-2741-4f32-806d-854d32cb5edb-kube-api-access-xnd8p\") pod \"iptables-alerter-t4qmv\" (UID: \"10e828d5-2741-4f32-806d-854d32cb5edb\") " pod="openshift-network-operator/iptables-alerter-t4qmv"
Jul 02 23:10:53.980008 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.979933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwvq6\" (UniqueName: \"kubernetes.io/projected/ebc843ff-e182-49bf-9134-222d3bc90041-kube-api-access-kwvq6\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.980008 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.979965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:10:53.980266 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.980014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-socket-dir\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.980266 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.980042    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-device-dir\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.980266 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.980133    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-device-dir\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.980266 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.980195    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.980266 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.980250    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-sys-fs\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.980266 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.980263    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/10e828d5-2741-4f32-806d-854d32cb5edb-iptables-alerter-script\") pod \"iptables-alerter-t4qmv\" (UID: \"10e828d5-2741-4f32-806d-854d32cb5edb\") " pod="openshift-network-operator/iptables-alerter-t4qmv"
Jul 02 23:10:53.980660 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.980328    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/904dd94e-b420-4d10-a889-3dd86aecf071-dbus\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:10:53.980660 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.980413    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-registration-dir\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.980660 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:53.980540    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:53.980660 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:53.980606    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret podName:904dd94e-b420-4d10-a889-3dd86aecf071 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:54.48058849 +0000 UTC m=+3.105006847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret") pod "global-pull-secret-syncer-fjtpp" (UID: "904dd94e-b420-4d10-a889-3dd86aecf071") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:53.980660 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.980622    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10e828d5-2741-4f32-806d-854d32cb5edb-host-slash\") pod \"iptables-alerter-t4qmv\" (UID: \"10e828d5-2741-4f32-806d-854d32cb5edb\") " pod="openshift-network-operator/iptables-alerter-t4qmv"
Jul 02 23:10:53.980941 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.980813    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/904dd94e-b420-4d10-a889-3dd86aecf071-kubelet-config\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:10:53.980941 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.980819    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ebc843ff-e182-49bf-9134-222d3bc90041-socket-dir\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.991925 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:53.991904    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:53.991925 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:53.991930    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:53.992106 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:53.991959    2563 projected.go:196] Error preparing data for projected volume kube-api-access-jdj4v for pod openshift-network-diagnostics/network-check-target-46nf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:53.992106 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:53.992030    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v podName:82141c32-ce33-4ece-b8af-7a5d455883a6 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:54.492014719 +0000 UTC m=+3.116433092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jdj4v" (UniqueName: "kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v") pod "network-check-target-46nf6" (UID: "82141c32-ce33-4ece-b8af-7a5d455883a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:53.993792 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.993770    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwvq6\" (UniqueName: \"kubernetes.io/projected/ebc843ff-e182-49bf-9134-222d3bc90041-kube-api-access-kwvq6\") pod \"aws-ebs-csi-driver-node-9s7vw\" (UID: \"ebc843ff-e182-49bf-9134-222d3bc90041\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:53.993901 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:53.993859    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnd8p\" (UniqueName: \"kubernetes.io/projected/10e828d5-2741-4f32-806d-854d32cb5edb-kube-api-access-xnd8p\") pod \"iptables-alerter-t4qmv\" (UID: \"10e828d5-2741-4f32-806d-854d32cb5edb\") " pod="openshift-network-operator/iptables-alerter-t4qmv"
Jul 02 23:10:54.054811 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.054786    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:10:54.066293 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.066261    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-48c2d"
Jul 02 23:10:54.079577 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.079558    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pzkxh"
Jul 02 23:10:54.084338 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.084316    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mmpkm"
Jul 02 23:10:54.093072 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.093055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v69lx"
Jul 02 23:10:54.103048 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.103024    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qhfwf"
Jul 02 23:10:54.111904 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.111886    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-drz79"
Jul 02 23:10:54.120579 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.120560    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t4qmv"
Jul 02 23:10:54.127390 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.127370    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw"
Jul 02 23:10:54.383255 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.383222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs\") pod \"network-metrics-daemon-stw2z\" (UID: \"b67810dc-1b52-4571-8430-9e1eb815d6e8\") " pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:10:54.383408 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:54.383372    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:54.383463 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:54.383431    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs podName:b67810dc-1b52-4571-8430-9e1eb815d6e8 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:55.383416395 +0000 UTC m=+4.007834750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs") pod "network-metrics-daemon-stw2z" (UID: "b67810dc-1b52-4571-8430-9e1eb815d6e8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:54.484227 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.484195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:10:54.484385 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:54.484312    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:54.484385 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:54.484362    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret podName:904dd94e-b420-4d10-a889-3dd86aecf071 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:55.484346587 +0000 UTC m=+4.108764941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret") pod "global-pull-secret-syncer-fjtpp" (UID: "904dd94e-b420-4d10-a889-3dd86aecf071") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:54.585181 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.585135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdj4v\" (UniqueName: \"kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v\") pod \"network-check-target-46nf6\" (UID: \"82141c32-ce33-4ece-b8af-7a5d455883a6\") " pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:10:54.585357 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:54.585325    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:54.585357 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:54.585347    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:54.585450 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:54.585361    2563 projected.go:196] Error preparing data for projected volume kube-api-access-jdj4v for pod openshift-network-diagnostics/network-check-target-46nf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:54.585450 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:54.585419    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v podName:82141c32-ce33-4ece-b8af-7a5d455883a6 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:55.585399741 +0000 UTC m=+4.209818107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdj4v" (UniqueName: "kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v") pod "network-check-target-46nf6" (UID: "82141c32-ce33-4ece-b8af-7a5d455883a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:54.866162 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.866127    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 23:05:54 +0000 UTC" deadline="2028-02-06 14:37:14.394596641 +0000 UTC"
Jul 02 23:10:54.866162 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.866159    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14007h26m19.528441587s"
Jul 02 23:10:54.880488 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.880463    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:10:54.880488 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.880476    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:10:54.880488 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:54.880480    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:10:54.880740 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:54.880587    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:10:54.880740 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:54.880717    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:10:54.880841 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:54.880798    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:10:55.393408 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:55.393250    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs\") pod \"network-metrics-daemon-stw2z\" (UID: \"b67810dc-1b52-4571-8430-9e1eb815d6e8\") " pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:10:55.393521 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:55.393384    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:55.393571 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:55.393525    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs podName:b67810dc-1b52-4571-8430-9e1eb815d6e8 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:57.393498168 +0000 UTC m=+6.017916523 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs") pod "network-metrics-daemon-stw2z" (UID: "b67810dc-1b52-4571-8430-9e1eb815d6e8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:55.494721 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:55.494687    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:10:55.495201 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:55.494894    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:55.495201 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:55.494977    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret podName:904dd94e-b420-4d10-a889-3dd86aecf071 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:57.494942123 +0000 UTC m=+6.119360480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret") pod "global-pull-secret-syncer-fjtpp" (UID: "904dd94e-b420-4d10-a889-3dd86aecf071") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:55.596005 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:55.595341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdj4v\" (UniqueName: \"kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v\") pod \"network-check-target-46nf6\" (UID: \"82141c32-ce33-4ece-b8af-7a5d455883a6\") " pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:10:55.596005 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:55.595539    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:55.596005 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:55.595559    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:55.596005 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:55.595572    2563 projected.go:196] Error preparing data for projected volume kube-api-access-jdj4v for pod openshift-network-diagnostics/network-check-target-46nf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:55.596005 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:55.595636    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v podName:82141c32-ce33-4ece-b8af-7a5d455883a6 nodeName:}" failed. No retries permitted until 2026-07-02 23:10:57.595618045 +0000 UTC m=+6.220036404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdj4v" (UniqueName: "kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v") pod "network-check-target-46nf6" (UID: "82141c32-ce33-4ece-b8af-7a5d455883a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:55.866732 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:55.866630    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 23:05:54 +0000 UTC" deadline="2028-01-27 08:28:15.748050372 +0000 UTC"
Jul 02 23:10:55.866732 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:55.866692    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13761h17m19.881362876s"
Jul 02 23:10:55.917109 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:55.917034    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v69lx" event={"ID":"2a588334-ee3c-4a30-a704-5e42f0dfae27","Type":"ContainerStarted","Data":"0bedf9becbe005b9b6ef3e241c16ccc470209efb73339ce83e446ce840f70f4b"}
Jul 02 23:10:55.924399 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:55.924344    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-drz79" event={"ID":"72acfc32-5be2-42a3-84e9-ec05bde76f43","Type":"ContainerStarted","Data":"a5a001ab8df6cfdad9877448b8c5f540d6019fb367dc459aef79b61e027dfd43"}
Jul 02 23:10:55.931185 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:55.931133    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmpkm" event={"ID":"ab285b66-20ac-4558-9ed4-900dd2e75ec3","Type":"ContainerStarted","Data":"8c829ab60d96d4d9b32f0dec713b986f2ff3b55ad39e940a8d800f3c2f247f54"}
Jul 02 23:10:55.944729 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:55.944701    2563 generic.go:356] "Generic (PLEG): container finished" podID="ebdc0778a9b8333df9269cbb287fc804" containerID="59afc3b56d493f782f1fa3133ed629629ceef7e0242b6162f7ff3f89fbb332c8" exitCode=0
Jul 02 23:10:55.944830 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:55.944780    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" event={"ID":"ebdc0778a9b8333df9269cbb287fc804","Type":"ContainerDied","Data":"59afc3b56d493f782f1fa3133ed629629ceef7e0242b6162f7ff3f89fbb332c8"}
Jul 02 23:10:55.963352 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:55.963291    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pzkxh" event={"ID":"03629f7d-15f4-4e0c-931c-fbcb131fa7c3","Type":"ContainerStarted","Data":"6b18bdc900cadd47bf0762cc36c19b2d16548cded21e91cd3ead365db9ed0b06"}
Jul 02 23:10:55.981589 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:55.981498    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qhfwf" event={"ID":"1ef5829b-63d7-4915-8269-5f2b46c6b2b1","Type":"ContainerStarted","Data":"96ded7f66408f8c9ee08710d23dbec0cd0eb27eaf1ba8e0157d331a289b750f2"}
Jul 02 23:10:55.994432 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:55.994369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw" event={"ID":"ebc843ff-e182-49bf-9134-222d3bc90041","Type":"ContainerStarted","Data":"fc14d4a1685abbe3183296398797ffa1a9bf4843557522211639e61a4e73cf07"}
Jul 02 23:10:56.007453 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:56.007418    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-48c2d" event={"ID":"98d4d36e-f535-4b18-bec3-f6e8057253c4","Type":"ContainerStarted","Data":"78cf8fa6e9d371f748e36417d9ea973f09822577c2a977e171bfdea388b61c2f"}
Jul 02 23:10:56.015378 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:56.015317    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal" event={"ID":"64a5aa117e63441d09828f87cebc30e8","Type":"ContainerStarted","Data":"9224731c4cb9103ae5fa47b6ce344bceb143781a047a0c6dafb6b8e92ed11cc3"}
Jul 02 23:10:56.029873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:56.029675    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz" event={"ID":"e54353ae-f9fa-42c5-aa16-76e35ccb54f6","Type":"ContainerStarted","Data":"9e27d0e78da29060f4202644d61c863032ce5ae15fd2fa6a211111714c7e496d"}
Jul 02 23:10:56.032552 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:56.032492    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-28.ec2.internal" podStartSLOduration=3.03247637 podStartE2EDuration="3.03247637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:56.032322246 +0000 UTC m=+4.656740629" watchObservedRunningTime="2026-07-02 23:10:56.03247637 +0000 UTC m=+4.656894749"
Jul 02 23:10:56.038951 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:56.038924    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t4qmv" event={"ID":"10e828d5-2741-4f32-806d-854d32cb5edb","Type":"ContainerStarted","Data":"9e0350dee3c624752fd133be360d09c30ee0df18e05ac6e16279c203fd0e6569"}
Jul 02 23:10:56.880201 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:56.880170    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:10:56.880713 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:56.880212    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:10:56.880713 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:56.880170    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:10:56.880713 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:56.880301    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:10:56.880713 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:56.880364    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:10:56.880713 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:56.880442    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:10:57.065451 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:57.065370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" event={"ID":"ebdc0778a9b8333df9269cbb287fc804","Type":"ContainerStarted","Data":"c7d0af2e8b3c3aa9a2bf70082433676a3cfec09c4c712dd887c65290518258d2"}
Jul 02 23:10:57.102794 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:57.101744    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-28.ec2.internal" podStartSLOduration=4.101723652 podStartE2EDuration="4.101723652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:57.101710465 +0000 UTC m=+5.726128844" watchObservedRunningTime="2026-07-02 23:10:57.101723652 +0000 UTC m=+5.726142031"
Jul 02 23:10:57.412958 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:57.412886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs\") pod \"network-metrics-daemon-stw2z\" (UID: \"b67810dc-1b52-4571-8430-9e1eb815d6e8\") " pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:10:57.413152 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:57.413101    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:57.413234 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:57.413165    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs podName:b67810dc-1b52-4571-8430-9e1eb815d6e8 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:01.413146269 +0000 UTC m=+10.037564630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs") pod "network-metrics-daemon-stw2z" (UID: "b67810dc-1b52-4571-8430-9e1eb815d6e8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:10:57.514177 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:57.514136    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:10:57.514353 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:57.514325    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:57.514416 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:57.514402    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret podName:904dd94e-b420-4d10-a889-3dd86aecf071 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:01.514382403 +0000 UTC m=+10.138800760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret") pod "global-pull-secret-syncer-fjtpp" (UID: "904dd94e-b420-4d10-a889-3dd86aecf071") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:10:57.614920 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:57.614851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdj4v\" (UniqueName: \"kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v\") pod \"network-check-target-46nf6\" (UID: \"82141c32-ce33-4ece-b8af-7a5d455883a6\") " pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:10:57.615120 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:57.615065    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:10:57.615120 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:57.615093    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:10:57.615120 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:57.615108    2563 projected.go:196] Error preparing data for projected volume kube-api-access-jdj4v for pod openshift-network-diagnostics/network-check-target-46nf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:57.615291 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:57.615168    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v podName:82141c32-ce33-4ece-b8af-7a5d455883a6 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:01.615148237 +0000 UTC m=+10.239566605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdj4v" (UniqueName: "kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v") pod "network-check-target-46nf6" (UID: "82141c32-ce33-4ece-b8af-7a5d455883a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:10:58.880393 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:58.879867    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:10:58.880393 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:58.880018    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:10:58.880393 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:58.880035    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:10:58.880393 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:58.880110    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:10:58.880393 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:10:58.880160    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:10:58.880393 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:10:58.880226    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:11:00.880981 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:00.880474    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:00.880981 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:00.880472    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:00.880981 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:00.880602    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:11:00.880981 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:00.880687    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:11:00.880981 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:00.880481    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:00.880981 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:00.880783    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:11:01.448535 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:01.448498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs\") pod \"network-metrics-daemon-stw2z\" (UID: \"b67810dc-1b52-4571-8430-9e1eb815d6e8\") " pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:01.448739 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:01.448723    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:11:01.448830 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:01.448791    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs podName:b67810dc-1b52-4571-8430-9e1eb815d6e8 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:09.448771134 +0000 UTC m=+18.073189494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs") pod "network-metrics-daemon-stw2z" (UID: "b67810dc-1b52-4571-8430-9e1eb815d6e8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:11:01.549364 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:01.549305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:01.549549 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:01.549459    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:11:01.549549 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:01.549547    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret podName:904dd94e-b420-4d10-a889-3dd86aecf071 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:09.549524556 +0000 UTC m=+18.173942932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret") pod "global-pull-secret-syncer-fjtpp" (UID: "904dd94e-b420-4d10-a889-3dd86aecf071") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:11:01.649851 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:01.649792    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdj4v\" (UniqueName: \"kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v\") pod \"network-check-target-46nf6\" (UID: \"82141c32-ce33-4ece-b8af-7a5d455883a6\") " pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:01.650068 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:01.650000    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:11:01.650068 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:01.650025    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:11:01.650068 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:01.650039    2563 projected.go:196] Error preparing data for projected volume kube-api-access-jdj4v for pod openshift-network-diagnostics/network-check-target-46nf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:11:01.650269 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:01.650123    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v podName:82141c32-ce33-4ece-b8af-7a5d455883a6 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:09.65009056 +0000 UTC m=+18.274508915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdj4v" (UniqueName: "kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v") pod "network-check-target-46nf6" (UID: "82141c32-ce33-4ece-b8af-7a5d455883a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:11:02.880670 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:02.880624    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:02.881161 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:02.880749    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:02.881161 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:02.880755    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:11:02.881161 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:02.880863    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:11:02.881161 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:02.880624    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:02.881161 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:02.881007    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:11:04.880390 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:04.880352    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:04.880852 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:04.880474    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:11:04.880852 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:04.880741    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:04.880852 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:04.880817    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:11:04.880852 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:04.880822    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:04.881083 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:04.880898    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:11:06.880338 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:06.880299    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:06.880790 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:06.880407    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:06.880790 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:06.880420    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:06.880790 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:06.880416    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:11:06.880790 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:06.880528    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:11:06.880790 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:06.880609    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:11:08.879797 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:08.879764    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:08.879797 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:08.879792    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:08.880402 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:08.879779    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:08.880402 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:08.879883    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:11:08.880402 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:08.879945    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:11:08.880402 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:08.880032    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:11:09.508785 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:09.508748    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs\") pod \"network-metrics-daemon-stw2z\" (UID: \"b67810dc-1b52-4571-8430-9e1eb815d6e8\") " pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:09.508986 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:09.508903    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:11:09.509057 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:09.508990    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs podName:b67810dc-1b52-4571-8430-9e1eb815d6e8 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:25.508968871 +0000 UTC m=+34.133387236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs") pod "network-metrics-daemon-stw2z" (UID: "b67810dc-1b52-4571-8430-9e1eb815d6e8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:11:09.609405 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:09.609368    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:09.609607 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:09.609535    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:11:09.609684 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:09.609611    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret podName:904dd94e-b420-4d10-a889-3dd86aecf071 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:25.609593111 +0000 UTC m=+34.234011489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret") pod "global-pull-secret-syncer-fjtpp" (UID: "904dd94e-b420-4d10-a889-3dd86aecf071") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:11:09.710435 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:09.710407    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdj4v\" (UniqueName: \"kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v\") pod \"network-check-target-46nf6\" (UID: \"82141c32-ce33-4ece-b8af-7a5d455883a6\") " pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:09.710599 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:09.710574    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:11:09.710599 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:09.710594    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:11:09.710693 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:09.710604    2563 projected.go:196] Error preparing data for projected volume kube-api-access-jdj4v for pod openshift-network-diagnostics/network-check-target-46nf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:11:09.710693 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:09.710673    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v podName:82141c32-ce33-4ece-b8af-7a5d455883a6 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:25.710635874 +0000 UTC m=+34.335054227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdj4v" (UniqueName: "kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v") pod "network-check-target-46nf6" (UID: "82141c32-ce33-4ece-b8af-7a5d455883a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:11:10.880616 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:10.880584    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:10.881083 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:10.880585    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:10.881083 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:10.880716    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:10.881083 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:10.880713    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:11:10.881083 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:10.880792    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:11:10.881083 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:10.880860    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:11:12.880579 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:12.880537    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:12.880579 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:12.880573    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:12.881111 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:12.880660    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:11:12.881111 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:12.880690    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:12.881111 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:12.880765    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:11:12.881111 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:12.880840    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:11:14.880719 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:14.880524    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:14.881479 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:14.880529    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:14.881479 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:14.880812    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:11:14.881479 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:14.880534    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:14.881479 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:14.880888    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:11:14.881479 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:14.880967    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:11:15.102225 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.102136    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-drz79" event={"ID":"72acfc32-5be2-42a3-84e9-ec05bde76f43","Type":"ContainerStarted","Data":"40b6fa9e4af8721717e93af206e9af0c96f92152a0c38dac80ca8ff7fbd28d60"}
Jul 02 23:11:15.103929 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.103893    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab285b66-20ac-4558-9ed4-900dd2e75ec3" containerID="a53cc2db59f2a18bfa9206e89547dbdd9b8a4506e1a9bf636bf21c69764037b1" exitCode=0
Jul 02 23:11:15.104057 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.103978    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmpkm" event={"ID":"ab285b66-20ac-4558-9ed4-900dd2e75ec3","Type":"ContainerDied","Data":"a53cc2db59f2a18bfa9206e89547dbdd9b8a4506e1a9bf636bf21c69764037b1"}
Jul 02 23:11:15.105643 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.105622    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pzkxh" event={"ID":"03629f7d-15f4-4e0c-931c-fbcb131fa7c3","Type":"ContainerStarted","Data":"aef89d6176ec4f41f6a40a5d4f62a446f29a7faac36597099920d7df7afcb159"}
Jul 02 23:11:15.107189 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.107143    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qhfwf" event={"ID":"1ef5829b-63d7-4915-8269-5f2b46c6b2b1","Type":"ContainerStarted","Data":"7f20bbf12e55d151ac1319f71aaf859afd990741daf7ce4126e1ad01c8d9ec68"}
Jul 02 23:11:15.108752 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.108730    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw" event={"ID":"ebc843ff-e182-49bf-9134-222d3bc90041","Type":"ContainerStarted","Data":"3154994052f9a50fd4c873606eb2546c1666b32e8a898d28d52f14b3ec1e2bae"}
Jul 02 23:11:15.110317 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.110272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-48c2d" event={"ID":"98d4d36e-f535-4b18-bec3-f6e8057253c4","Type":"ContainerStarted","Data":"b6b64cdf1014276d680ff560962b3bc15e35c392bb66bffd1b259c3077d7212e"}
Jul 02 23:11:15.113409 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.113391    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz" event={"ID":"e54353ae-f9fa-42c5-aa16-76e35ccb54f6","Type":"ContainerStarted","Data":"19d4291ca0a0bfa1efb27bea1f0686d9774cb279cc71e03ac54bea75ced9eb52"}
Jul 02 23:11:15.113501 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.113453    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz" event={"ID":"e54353ae-f9fa-42c5-aa16-76e35ccb54f6","Type":"ContainerStarted","Data":"f1731604bd6cada3183df87a7651105d3b28f06ecedd8d9a99a7bf7ba735693f"}
Jul 02 23:11:15.113559 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.113500    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz" event={"ID":"e54353ae-f9fa-42c5-aa16-76e35ccb54f6","Type":"ContainerStarted","Data":"bf5242171364609911aa2fbba200888026de56f76ccce407143bd74f9cc8fff3"}
Jul 02 23:11:15.113559 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.113548    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz" event={"ID":"e54353ae-f9fa-42c5-aa16-76e35ccb54f6","Type":"ContainerStarted","Data":"b7578d9cde2d4abbc9603ae7d422ed4bbdded96cab45c1bf878fcd59eb335d19"}
Jul 02 23:11:15.113657 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.113584    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz" event={"ID":"e54353ae-f9fa-42c5-aa16-76e35ccb54f6","Type":"ContainerStarted","Data":"e52cc348835762855a947caa7a7f3a66e0ebbcaded8cbb34be5888a3beef3532"}
Jul 02 23:11:15.113657 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.113631    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz" event={"ID":"e54353ae-f9fa-42c5-aa16-76e35ccb54f6","Type":"ContainerStarted","Data":"dbeff05724dd70af4417cb341115232eff9d6e3f980f9eae64396af2b2b21940"}
Jul 02 23:11:15.114830 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.114808    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v69lx" event={"ID":"2a588334-ee3c-4a30-a704-5e42f0dfae27","Type":"ContainerStarted","Data":"9efbdf756dfad61c9346aff1401bcef61ba1e138807ac065745d141bb0a80a60"}
Jul 02 23:11:15.124469 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.124426    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-drz79" podStartSLOduration=3.016708855 podStartE2EDuration="22.124414445s" totalImagesPullingTime="19.10770559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:15.122421418 +0000 UTC m=+23.746839792" watchObservedRunningTime="2026-07-02 23:11:15.124414445 +0000 UTC m=+23.748832819"
Jul 02 23:11:15.141859 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.141823    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qhfwf" podStartSLOduration=3.102566551 podStartE2EDuration="22.14181449s" totalImagesPullingTime="19.039247939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:15.141556098 +0000 UTC m=+23.765974472" watchObservedRunningTime="2026-07-02 23:11:15.14181449 +0000 UTC m=+23.766232895"
Jul 02 23:11:15.159928 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.159870    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-48c2d" podStartSLOduration=4.097617522 podStartE2EDuration="23.159852526s" totalImagesPullingTime="19.062235004s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:15.159472342 +0000 UTC m=+23.783890728" watchObservedRunningTime="2026-07-02 23:11:15.159852526 +0000 UTC m=+23.784270901"
Jul 02 23:11:15.227121 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.227079    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v69lx" podStartSLOduration=3.188113675 podStartE2EDuration="22.227064658s" totalImagesPullingTime="19.038950983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:15.226556063 +0000 UTC m=+23.850974437" watchObservedRunningTime="2026-07-02 23:11:15.227064658 +0000 UTC m=+23.851483032"
Jul 02 23:11:15.649443 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.649419    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 23:11:15.830075 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.829946    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T23:11:15.64943658Z","UUID":"ea36022a-02c9-4ca4-99fb-c4a5c3ec07fa","Handler":null,"Name":"","Endpoint":""}
Jul 02 23:11:15.831457 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.831442    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 23:11:15.831538 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:15.831473    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 23:11:16.118335 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:16.118301    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw" event={"ID":"ebc843ff-e182-49bf-9134-222d3bc90041","Type":"ContainerStarted","Data":"b849b2d68280532572ac7cd51db3381ee4a792e21ac62820be058e4565c45c85"}
Jul 02 23:11:16.119611 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:16.119583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t4qmv" event={"ID":"10e828d5-2741-4f32-806d-854d32cb5edb","Type":"ContainerStarted","Data":"45fddda19a4d0a5f469f641947c812e991f2104bd8ee5285518caa5dcabce0ff"}
Jul 02 23:11:16.145420 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:16.145369    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pzkxh" podStartSLOduration=5.520175568 podStartE2EDuration="24.145352387s" totalImagesPullingTime="18.625176819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:15.250431316 +0000 UTC m=+23.874849690" watchObservedRunningTime="2026-07-02 23:11:16.145352387 +0000 UTC m=+24.769770762"
Jul 02 23:11:16.879906 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:16.879885    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:16.880017 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:16.879885    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:16.880017 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:16.880002    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:11:16.880119 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:16.880055    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:11:16.880119 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:16.879885    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:16.880194 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:16.880133    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:11:17.124712 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:17.124629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw" event={"ID":"ebc843ff-e182-49bf-9134-222d3bc90041","Type":"ContainerStarted","Data":"04d9a629244579cd86896cfc6e1011ab927797442baa1daa43f97bdef8a59300"}
Jul 02 23:11:17.128200 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:17.128170    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz" event={"ID":"e54353ae-f9fa-42c5-aa16-76e35ccb54f6","Type":"ContainerStarted","Data":"ad1e2ff51518fde04e06cefb8a7ccf9ca316b270a55940ed037225ad340770b6"}
Jul 02 23:11:17.147078 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:17.147038    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t4qmv" podStartSLOduration=5.104143929 podStartE2EDuration="24.147023782s" totalImagesPullingTime="19.042879853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:16.14546781 +0000 UTC m=+24.769886186" watchObservedRunningTime="2026-07-02 23:11:17.147023782 +0000 UTC m=+25.771442157"
Jul 02 23:11:18.879893 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:18.879710    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:18.880450 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:18.879745    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:18.880450 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:18.879991    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:11:18.880450 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:18.879785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:18.880450 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:18.880064    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:11:18.880450 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:18.880109    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:11:19.200815 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:19.200728    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pzkxh"
Jul 02 23:11:19.201670 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:19.201649    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pzkxh"
Jul 02 23:11:19.219371 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:19.219330    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9s7vw" podStartSLOduration=4.829681133 podStartE2EDuration="26.219314739s" totalImagesPullingTime="21.389633606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:17.148404841 +0000 UTC m=+25.772823216" watchObservedRunningTime="2026-07-02 23:11:19.219314739 +0000 UTC m=+27.843733092"
Jul 02 23:11:20.134896 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:20.134874    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pzkxh"
Jul 02 23:11:20.135424 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:20.135410    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pzkxh"
Jul 02 23:11:20.880071 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:20.879897    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:20.880251 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:20.879898    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:20.880251 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:20.880150    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:11:20.880251 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:20.879898    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:20.880341 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:20.880203    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:11:20.880341 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:20.880279    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:11:21.139897 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:21.139827    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz" event={"ID":"e54353ae-f9fa-42c5-aa16-76e35ccb54f6","Type":"ContainerStarted","Data":"05111adaf80c4a6fb9ff49c801f9d3601051f934c7f45f47814fe69c08ddd424"}
Jul 02 23:11:21.140587 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:21.140198    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:11:21.140587 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:21.140260    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:11:21.140587 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:21.140300    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:11:21.141793 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:21.141764    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab285b66-20ac-4558-9ed4-900dd2e75ec3" containerID="bedd039dc4c8b72d2fa7f035e68883175c84b3d74ce53eb6ed0f8d1888430da2" exitCode=0
Jul 02 23:11:21.141898 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:21.141806    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmpkm" event={"ID":"ab285b66-20ac-4558-9ed4-900dd2e75ec3","Type":"ContainerDied","Data":"bedd039dc4c8b72d2fa7f035e68883175c84b3d74ce53eb6ed0f8d1888430da2"}
Jul 02 23:11:21.155387 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:21.155368    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:11:21.155503 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:21.155492    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:11:21.176737 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:21.176704    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz" podStartSLOduration=10.079395519 podStartE2EDuration="29.176692354s" totalImagesPullingTime="19.097296835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:21.175369941 +0000 UTC m=+29.799788316" watchObservedRunningTime="2026-07-02 23:11:21.176692354 +0000 UTC m=+29.801110712"
Jul 02 23:11:22.150297 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:22.150274    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-46nf6"]
Jul 02 23:11:22.150679 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:22.150377    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:22.150679 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:22.150470    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:11:22.154166 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:22.154139    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-stw2z"]
Jul 02 23:11:22.154278 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:22.154237    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:22.154367 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:22.154330    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:11:22.154873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:22.154841    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjtpp"]
Jul 02 23:11:22.154974 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:22.154941    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:22.155061 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:22.155029    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:11:23.148176 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:23.148138    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab285b66-20ac-4558-9ed4-900dd2e75ec3" containerID="c964c8cc661318e4a6d875eb5b202a5ca0f42405911db32ad7284313e089ba14" exitCode=0
Jul 02 23:11:23.148327 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:23.148251    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmpkm" event={"ID":"ab285b66-20ac-4558-9ed4-900dd2e75ec3","Type":"ContainerDied","Data":"c964c8cc661318e4a6d875eb5b202a5ca0f42405911db32ad7284313e089ba14"}
Jul 02 23:11:23.880651 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:23.880623    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:23.881012 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:23.880729    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:11:23.881012 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:23.880623    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:23.881012 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:23.880623    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:23.881012 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:23.880798    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:11:23.881012 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:23.880895    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:11:25.155371 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:25.155173    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab285b66-20ac-4558-9ed4-900dd2e75ec3" containerID="6d5274fec666639c6df4b8d5af12aa24e5cdc2a598082f7a6bda5cca77330818" exitCode=0
Jul 02 23:11:25.155371 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:25.155254    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmpkm" event={"ID":"ab285b66-20ac-4558-9ed4-900dd2e75ec3","Type":"ContainerDied","Data":"6d5274fec666639c6df4b8d5af12aa24e5cdc2a598082f7a6bda5cca77330818"}
Jul 02 23:11:25.539681 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:25.539652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs\") pod \"network-metrics-daemon-stw2z\" (UID: \"b67810dc-1b52-4571-8430-9e1eb815d6e8\") " pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:25.539836 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:25.539743    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:11:25.539836 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:25.539786    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs podName:b67810dc-1b52-4571-8430-9e1eb815d6e8 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:57.53977474 +0000 UTC m=+66.164193093 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs") pod "network-metrics-daemon-stw2z" (UID: "b67810dc-1b52-4571-8430-9e1eb815d6e8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:11:25.640129 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:25.640089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:25.640283 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:25.640253    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:11:25.640345 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:25.640314    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret podName:904dd94e-b420-4d10-a889-3dd86aecf071 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:57.640297953 +0000 UTC m=+66.264716316 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret") pod "global-pull-secret-syncer-fjtpp" (UID: "904dd94e-b420-4d10-a889-3dd86aecf071") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:11:25.741082 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:25.741051    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdj4v\" (UniqueName: \"kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v\") pod \"network-check-target-46nf6\" (UID: \"82141c32-ce33-4ece-b8af-7a5d455883a6\") " pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:25.741238 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:25.741215    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:11:25.741295 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:25.741241    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:11:25.741295 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:25.741254    2563 projected.go:196] Error preparing data for projected volume kube-api-access-jdj4v for pod openshift-network-diagnostics/network-check-target-46nf6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:11:25.741373 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:25.741312    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v podName:82141c32-ce33-4ece-b8af-7a5d455883a6 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:57.741293057 +0000 UTC m=+66.365711412 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdj4v" (UniqueName: "kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v") pod "network-check-target-46nf6" (UID: "82141c32-ce33-4ece-b8af-7a5d455883a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:11:25.883446 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:25.883422    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:25.883615 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:25.883535    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:25.883615 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:25.883564    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:25.883720 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:25.883534    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-stw2z" podUID="b67810dc-1b52-4571-8430-9e1eb815d6e8"
Jul 02 23:11:25.883720 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:25.883637    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fjtpp" podUID="904dd94e-b420-4d10-a889-3dd86aecf071"
Jul 02 23:11:25.883720 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:25.883698    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-46nf6" podUID="82141c32-ce33-4ece-b8af-7a5d455883a6"
Jul 02 23:11:27.134814 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.134784    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-28.ec2.internal" event="NodeReady"
Jul 02 23:11:27.135302 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.134941    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 23:11:27.171265 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.171234    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8"]
Jul 02 23:11:27.173066 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.173047    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8"
Jul 02 23:11:27.176635 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.176611    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-74p9r"]
Jul 02 23:11:27.176872 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.176846    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 02 23:11:27.177382 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.177338    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 02 23:11:27.177586 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.177567    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:11:27.177674 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.177660    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 02 23:11:27.178848 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.178296    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86677c8bd8-rsngf"]
Jul 02 23:11:27.178848 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.178511    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xgbns\""
Jul 02 23:11:27.179018 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.178950    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-74p9r"
Jul 02 23:11:27.180010 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.179990    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"]
Jul 02 23:11:27.180101 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.180075    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.181946 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.181847    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-storage-operator\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 02 23:11:27.182050 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.182004    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-storage-operator\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 02 23:11:27.182196 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.182106    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6bf5644d8f-z2hn2"]
Jul 02 23:11:27.182196 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.182125    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"volume-data-source-validator-dockercfg-lz7qd\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-cluster-storage-operator\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lz7qd\"" type="*v1.Secret"
Jul 02 23:11:27.182341 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.182236    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"
Jul 02 23:11:27.182455 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.182432    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" type="*v1.ConfigMap"
Jul 02 23:11:27.183124 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.183094    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-private-configuration\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" type="*v1.Secret"
Jul 02 23:11:27.183124 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.183094    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"installation-pull-secrets\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" type="*v1.Secret"
Jul 02 23:11:27.183648 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.183412    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"registry-dockercfg-kcbnf\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kcbnf\"" type="*v1.Secret"
Jul 02 23:11:27.183977 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.183960    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"]
Jul 02 23:11:27.184091 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.184071    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:27.185599 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.185582    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-bw4cj"]
Jul 02 23:11:27.185691 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.185673    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:27.185823 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.185797    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-tls\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" type="*v1.Secret"
Jul 02 23:11:27.187080 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.187064    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-8jdxr"]
Jul 02 23:11:27.187206 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.187189    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:27.187828 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.187799    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"samples-operator-tls\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" type="*v1.Secret"
Jul 02 23:11:27.187935 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.187847    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 02 23:11:27.188047 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.188025    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 02 23:11:27.188320 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.188293    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-samples-operator-dockercfg-krsfl\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-cluster-samples-operator\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-krsfl\"" type="*v1.Secret"
Jul 02 23:11:27.188419 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.188369    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-ingress-cert\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" type="*v1.Secret"
Jul 02 23:11:27.189712 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.189683    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln"]
Jul 02 23:11:27.189847 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.189826    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:27.190483 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.190457    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-monitoring-operator-dockercfg-75ddl\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-75ddl\"" type="*v1.Secret"
Jul 02 23:11:27.190568 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.190476    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 02 23:11:27.191288 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.191272    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln"
Jul 02 23:11:27.191387 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.191362    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 02 23:11:27.191387 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.191376    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-dockercfg-ljjlr\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ljjlr\"" type="*v1.Secret"
Jul 02 23:11:27.191828 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.191684    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"telemetry-config\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" type="*v1.ConfigMap"
Jul 02 23:11:27.191828 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.191709    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 02 23:11:27.191828 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.191738    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca-bundle\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" type="*v1.ConfigMap"
Jul 02 23:11:27.191828 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.191741    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-monitoring-operator-tls\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" type="*v1.Secret"
Jul 02 23:11:27.192245 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.192217    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 02 23:11:27.192336 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.192284    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca-bundle\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" type="*v1.ConfigMap"
Jul 02 23:11:27.192336 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.192296    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"openshift-insights-serving-cert\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" type="*v1.Secret"
Jul 02 23:11:27.192456 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.192336    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 02 23:11:27.192456 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.192352    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca-bundle\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap"
Jul 02 23:11:27.192456 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.192369    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-metrics-certs-default\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" type="*v1.Secret"
Jul 02 23:11:27.192456 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.192382    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"router-stats-default\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" type="*v1.Secret"
Jul 02 23:11:27.192456 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.192405    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"operator-dockercfg-8ws2s\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8ws2s\"" type="*v1.Secret"
Jul 02 23:11:27.192680 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.192531    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 02 23:11:27.192680 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.192557    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" type="*v1.ConfigMap"
Jul 02 23:11:27.192680 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.192558    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"console-operator-dockercfg-r9chl\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-r9chl\"" type="*v1.Secret"
Jul 02 23:11:27.192680 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.192577    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 02 23:11:27.192680 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.192587    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" type="*v1.Secret"
Jul 02 23:11:27.192845 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.192688    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 02 23:11:27.192845 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.192712    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"console-operator-config\" is forbidden: User \"system:node:ip-10-0-134-28.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-134-28.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" type="*v1.ConfigMap"
Jul 02 23:11:27.195480 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.195251    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8"]
Jul 02 23:11:27.199243 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.199223    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:11:27.199384 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.199361    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 02 23:11:27.199776 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.199733    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"]
Jul 02 23:11:27.204550 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.204529    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 02 23:11:27.204550 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.204541    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-44swl\""
Jul 02 23:11:27.206275 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.206122    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 02 23:11:27.208456 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.207650    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-8jdxr"]
Jul 02 23:11:27.209467 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.209073    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bf5644d8f-z2hn2"]
Jul 02 23:11:27.209818 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.209803    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-bw4cj"]
Jul 02 23:11:27.210579 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.210556    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-jtpjz"]
Jul 02 23:11:27.219864 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.219845    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln"]
Jul 02 23:11:27.219958 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.219875    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"]
Jul 02 23:11:27.219958 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.219893    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-74p9r"]
Jul 02 23:11:27.220048 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.219992    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jtpjz"
Jul 02 23:11:27.223338 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.223318    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-czlg8\""
Jul 02 23:11:27.223428 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.223358    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 23:11:27.223729 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.223711    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 23:11:27.225254 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.225236    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86677c8bd8-rsngf"]
Jul 02 23:11:27.228267 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.228248    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-jtpjz"]
Jul 02 23:11:27.231494 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.231474    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jhbxf"]
Jul 02 23:11:27.233728 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.233710    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-25fl5"]
Jul 02 23:11:27.233822 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.233780    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jhbxf"
Jul 02 23:11:27.235469 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.235453    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:27.236825 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.236807    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 23:11:27.236908 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.236894    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 23:11:27.238108 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.238093    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rpvf9\""
Jul 02 23:11:27.238229 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.238196    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2clb5\""
Jul 02 23:11:27.238318 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.238301    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 23:11:27.238484 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.238410    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 23:11:27.238583 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.238516    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 23:11:27.247717 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.247662    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-25fl5"]
Jul 02 23:11:27.248340 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.248323    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jhbxf"]
Jul 02 23:11:27.351277 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351244    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/823999b1-3441-46f4-bc9b-d4fea707df74-trusted-ca\") pod \"console-operator-68b757fb67-8jdxr\" (UID: \"823999b1-3441-46f4-bc9b-d4fea707df74\") " pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:27.351425 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq26k\" (UniqueName: \"kubernetes.io/projected/9874c716-714c-46b7-a814-a4634c608e26-kube-api-access-cq26k\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:27.351425 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351334    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlwh9\" (UniqueName: \"kubernetes.io/projected/67181f51-bec1-45d0-a1a5-f60f25e7d392-kube-api-access-mlwh9\") pod \"volume-data-source-validator-5d456fdbcd-74p9r\" (UID: \"67181f51-bec1-45d0-a1a5-f60f25e7d392\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-74p9r"
Jul 02 23:11:27.351425 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:27.351597 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351431    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-r6cz8\" (UID: \"ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8"
Jul 02 23:11:27.351597 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/823999b1-3441-46f4-bc9b-d4fea707df74-config\") pod \"console-operator-68b757fb67-8jdxr\" (UID: \"823999b1-3441-46f4-bc9b-d4fea707df74\") " pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:27.351597 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9874c716-714c-46b7-a814-a4634c608e26-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:27.351597 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351556    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:27.351597 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-image-registry-private-configuration\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.351789 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351616    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a3f9c3bd-e3f0-4b40-885e-568e2fe525ba-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-bgzln\" (UID: \"a3f9c3bd-e3f0-4b40-885e-568e2fe525ba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln"
Jul 02 23:11:27.351789 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49nv7\" (UniqueName: \"kubernetes.io/projected/a3f9c3bd-e3f0-4b40-885e-568e2fe525ba-kube-api-access-49nv7\") pod \"kube-storage-version-migrator-operator-846bf668f7-bgzln\" (UID: \"a3f9c3bd-e3f0-4b40-885e-568e2fe525ba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln"
Jul 02 23:11:27.351789 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351671    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppkff\" (UID: \"8fe31884-e666-46fd-a2c2-d99a9bd43fa7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"
Jul 02 23:11:27.351789 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351687    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53af15b8-273e-497b-8923-ef7a99665e48-cert\") pod \"ingress-canary-jhbxf\" (UID: \"53af15b8-273e-497b-8923-ef7a99665e48\") " pod="openshift-ingress-canary/ingress-canary-jhbxf"
Jul 02 23:11:27.351789 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-default-certificate\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:27.351789 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/19854b9a-bf87-470b-8247-726cf8e416a9-config-volume\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:27.351789 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351772    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4jfg\" (UniqueName: \"kubernetes.io/projected/823999b1-3441-46f4-bc9b-d4fea707df74-kube-api-access-p4jfg\") pod \"console-operator-68b757fb67-8jdxr\" (UID: \"823999b1-3441-46f4-bc9b-d4fea707df74\") " pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:27.352130 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351795    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.352130 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-bound-sa-token\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.352130 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3f9c3bd-e3f0-4b40-885e-568e2fe525ba-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-bgzln\" (UID: \"a3f9c3bd-e3f0-4b40-885e-568e2fe525ba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln"
Jul 02 23:11:27.352130 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9874c716-714c-46b7-a814-a4634c608e26-snapshots\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:27.352130 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtz8n\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-kube-api-access-jtz8n\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.352130 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351942    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:27.352130 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.351976    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:27.352130 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs6gn\" (UniqueName: \"kubernetes.io/projected/ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad-kube-api-access-gs6gn\") pod \"service-ca-operator-5d46d9ffd4-r6cz8\" (UID: \"ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8"
Jul 02 23:11:27.352130 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9874c716-714c-46b7-a814-a4634c608e26-tmp\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:27.352130 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352064    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9874c716-714c-46b7-a814-a4634c608e26-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:27.352130 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnbvg\" (UniqueName: \"kubernetes.io/projected/19854b9a-bf87-470b-8247-726cf8e416a9-kube-api-access-bnbvg\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:27.352130 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19854b9a-bf87-470b-8247-726cf8e416a9-tmp-dir\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:27.352669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352165    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad-config\") pod \"service-ca-operator-5d46d9ffd4-r6cz8\" (UID: \"ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8"
Jul 02 23:11:27.352669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352187    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9874c716-714c-46b7-a814-a4634c608e26-serving-cert\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:27.352669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352209    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-certificates\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.352669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352236    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-installation-pull-secrets\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.352669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bllld\" (UniqueName: \"kubernetes.io/projected/601926a3-d0eb-48ae-b39c-bb878447f030-kube-api-access-bllld\") pod \"network-check-source-989f8b8dc-jtpjz\" (UID: \"601926a3-d0eb-48ae-b39c-bb878447f030\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jtpjz"
Jul 02 23:11:27.352669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352289    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:27.352669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-stats-auth\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:27.352669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352369    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/823999b1-3441-46f4-bc9b-d4fea707df74-serving-cert\") pod \"console-operator-68b757fb67-8jdxr\" (UID: \"823999b1-3441-46f4-bc9b-d4fea707df74\") " pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:27.352669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352392    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g4dq\" (UniqueName: \"kubernetes.io/projected/53af15b8-273e-497b-8923-ef7a99665e48-kube-api-access-6g4dq\") pod \"ingress-canary-jhbxf\" (UID: \"53af15b8-273e-497b-8923-ef7a99665e48\") " pod="openshift-ingress-canary/ingress-canary-jhbxf"
Jul 02 23:11:27.352669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a16baa0f-554a-469b-a393-d447c0bae9f2-ca-trust-extracted\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.352669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352437    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cntz2\" (UniqueName: \"kubernetes.io/projected/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-kube-api-access-cntz2\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:27.352669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2xxk\" (UniqueName: \"kubernetes.io/projected/44bb06c8-7187-4452-9d34-7d8094f61e3c-kube-api-access-v2xxk\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:27.352669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a16baa0f-554a-469b-a393-d447c0bae9f2-trusted-ca\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.353236 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.352564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgcrc\" (UniqueName: \"kubernetes.io/projected/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-kube-api-access-vgcrc\") pod \"cluster-samples-operator-56fcf86bf-ppkff\" (UID: \"8fe31884-e666-46fd-a2c2-d99a9bd43fa7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"
Jul 02 23:11:27.386953 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.386735    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pzkxh_03629f7d-15f4-4e0c-931c-fbcb131fa7c3/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:27.453239 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453211    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2xxk\" (UniqueName: \"kubernetes.io/projected/44bb06c8-7187-4452-9d34-7d8094f61e3c-kube-api-access-v2xxk\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:27.453389 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a16baa0f-554a-469b-a393-d447c0bae9f2-trusted-ca\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.453389 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453368    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgcrc\" (UniqueName: \"kubernetes.io/projected/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-kube-api-access-vgcrc\") pod \"cluster-samples-operator-56fcf86bf-ppkff\" (UID: \"8fe31884-e666-46fd-a2c2-d99a9bd43fa7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"
Jul 02 23:11:27.453504 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453405    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/823999b1-3441-46f4-bc9b-d4fea707df74-trusted-ca\") pod \"console-operator-68b757fb67-8jdxr\" (UID: \"823999b1-3441-46f4-bc9b-d4fea707df74\") " pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:27.453504 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq26k\" (UniqueName: \"kubernetes.io/projected/9874c716-714c-46b7-a814-a4634c608e26-kube-api-access-cq26k\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:27.453504 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453455    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlwh9\" (UniqueName: \"kubernetes.io/projected/67181f51-bec1-45d0-a1a5-f60f25e7d392-kube-api-access-mlwh9\") pod \"volume-data-source-validator-5d456fdbcd-74p9r\" (UID: \"67181f51-bec1-45d0-a1a5-f60f25e7d392\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-74p9r"
Jul 02 23:11:27.453504 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:27.453690 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453510    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-r6cz8\" (UID: \"ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8"
Jul 02 23:11:27.453690 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/823999b1-3441-46f4-bc9b-d4fea707df74-config\") pod \"console-operator-68b757fb67-8jdxr\" (UID: \"823999b1-3441-46f4-bc9b-d4fea707df74\") " pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:27.453690 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9874c716-714c-46b7-a814-a4634c608e26-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:27.453690 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:27.453690 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.453609    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:11:27.453690 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-image-registry-private-configuration\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.453690 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.453660    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls podName:19854b9a-bf87-470b-8247-726cf8e416a9 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:27.953642376 +0000 UTC m=+36.578060732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls") pod "dns-default-25fl5" (UID: "19854b9a-bf87-470b-8247-726cf8e416a9") : secret "dns-default-metrics-tls" not found
Jul 02 23:11:27.453690 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453661    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a3f9c3bd-e3f0-4b40-885e-568e2fe525ba-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-bgzln\" (UID: \"a3f9c3bd-e3f0-4b40-885e-568e2fe525ba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln"
Jul 02 23:11:27.454066 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49nv7\" (UniqueName: \"kubernetes.io/projected/a3f9c3bd-e3f0-4b40-885e-568e2fe525ba-kube-api-access-49nv7\") pod \"kube-storage-version-migrator-operator-846bf668f7-bgzln\" (UID: \"a3f9c3bd-e3f0-4b40-885e-568e2fe525ba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln"
Jul 02 23:11:27.454066 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppkff\" (UID: \"8fe31884-e666-46fd-a2c2-d99a9bd43fa7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"
Jul 02 23:11:27.454066 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53af15b8-273e-497b-8923-ef7a99665e48-cert\") pod \"ingress-canary-jhbxf\" (UID: \"53af15b8-273e-497b-8923-ef7a99665e48\") " pod="openshift-ingress-canary/ingress-canary-jhbxf"
Jul 02 23:11:27.454066 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453838    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-default-certificate\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:27.454066 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/19854b9a-bf87-470b-8247-726cf8e416a9-config-volume\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:27.454066 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4jfg\" (UniqueName: \"kubernetes.io/projected/823999b1-3441-46f4-bc9b-d4fea707df74-kube-api-access-p4jfg\") pod \"console-operator-68b757fb67-8jdxr\" (UID: \"823999b1-3441-46f4-bc9b-d4fea707df74\") " pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:27.454066 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453943    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.454066 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.453967    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-bound-sa-token\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.454066 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454020    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3f9c3bd-e3f0-4b40-885e-568e2fe525ba-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-bgzln\" (UID: \"a3f9c3bd-e3f0-4b40-885e-568e2fe525ba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln"
Jul 02 23:11:27.454464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9874c716-714c-46b7-a814-a4634c608e26-snapshots\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:27.454464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454112    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtz8n\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-kube-api-access-jtz8n\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.454464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:27.454464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:27.454464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs6gn\" (UniqueName: \"kubernetes.io/projected/ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad-kube-api-access-gs6gn\") pod \"service-ca-operator-5d46d9ffd4-r6cz8\" (UID: \"ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8"
Jul 02 23:11:27.454464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9874c716-714c-46b7-a814-a4634c608e26-tmp\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:27.454464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9874c716-714c-46b7-a814-a4634c608e26-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:27.454464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnbvg\" (UniqueName: \"kubernetes.io/projected/19854b9a-bf87-470b-8247-726cf8e416a9-kube-api-access-bnbvg\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:27.454464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19854b9a-bf87-470b-8247-726cf8e416a9-tmp-dir\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:27.454464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454380    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad-config\") pod \"service-ca-operator-5d46d9ffd4-r6cz8\" (UID: \"ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8"
Jul 02 23:11:27.454464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9874c716-714c-46b7-a814-a4634c608e26-serving-cert\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:27.454464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454434    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-certificates\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.454464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-installation-pull-secrets\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.455068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454466    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a3f9c3bd-e3f0-4b40-885e-568e2fe525ba-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-bgzln\" (UID: \"a3f9c3bd-e3f0-4b40-885e-568e2fe525ba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln"
Jul 02 23:11:27.455068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bllld\" (UniqueName: \"kubernetes.io/projected/601926a3-d0eb-48ae-b39c-bb878447f030-kube-api-access-bllld\") pod \"network-check-source-989f8b8dc-jtpjz\" (UID: \"601926a3-d0eb-48ae-b39c-bb878447f030\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jtpjz"
Jul 02 23:11:27.455068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454530    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:27.455068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454595    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-stats-auth\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:27.455068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/823999b1-3441-46f4-bc9b-d4fea707df74-serving-cert\") pod \"console-operator-68b757fb67-8jdxr\" (UID: \"823999b1-3441-46f4-bc9b-d4fea707df74\") " pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:27.455068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g4dq\" (UniqueName: \"kubernetes.io/projected/53af15b8-273e-497b-8923-ef7a99665e48-kube-api-access-6g4dq\") pod \"ingress-canary-jhbxf\" (UID: \"53af15b8-273e-497b-8923-ef7a99665e48\") " pod="openshift-ingress-canary/ingress-canary-jhbxf"
Jul 02 23:11:27.455068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454682    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a16baa0f-554a-469b-a393-d447c0bae9f2-ca-trust-extracted\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.455068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.454727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cntz2\" (UniqueName: \"kubernetes.io/projected/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-kube-api-access-cntz2\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:27.455395 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.455259    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9874c716-714c-46b7-a814-a4634c608e26-snapshots\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:27.455895 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.455704    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9874c716-714c-46b7-a814-a4634c608e26-tmp\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:27.455895 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.455687    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19854b9a-bf87-470b-8247-726cf8e416a9-tmp-dir\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:27.455895 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.455798    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad-config\") pod \"service-ca-operator-5d46d9ffd4-r6cz8\" (UID: \"ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8"
Jul 02 23:11:27.455895 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.455856    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a16baa0f-554a-469b-a393-d447c0bae9f2-ca-trust-extracted\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.455895 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.455868    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-certificates\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.456224 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.456065    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/19854b9a-bf87-470b-8247-726cf8e416a9-config-volume\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:27.458450 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.458430    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3f9c3bd-e3f0-4b40-885e-568e2fe525ba-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-bgzln\" (UID: \"a3f9c3bd-e3f0-4b40-885e-568e2fe525ba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln"
Jul 02 23:11:27.458572 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.458446    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-r6cz8\" (UID: \"ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8"
Jul 02 23:11:27.458701 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.458681    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53af15b8-273e-497b-8923-ef7a99665e48-cert\") pod \"ingress-canary-jhbxf\" (UID: \"53af15b8-273e-497b-8923-ef7a99665e48\") " pod="openshift-ingress-canary/ingress-canary-jhbxf"
Jul 02 23:11:27.463959 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.463934    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-bound-sa-token\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.464592 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.464571    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs6gn\" (UniqueName: \"kubernetes.io/projected/ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad-kube-api-access-gs6gn\") pod \"service-ca-operator-5d46d9ffd4-r6cz8\" (UID: \"ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8"
Jul 02 23:11:27.469341 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.469288    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g4dq\" (UniqueName: \"kubernetes.io/projected/53af15b8-273e-497b-8923-ef7a99665e48-kube-api-access-6g4dq\") pod \"ingress-canary-jhbxf\" (UID: \"53af15b8-273e-497b-8923-ef7a99665e48\") " pod="openshift-ingress-canary/ingress-canary-jhbxf"
Jul 02 23:11:27.469998 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.469861    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bllld\" (UniqueName: \"kubernetes.io/projected/601926a3-d0eb-48ae-b39c-bb878447f030-kube-api-access-bllld\") pod \"network-check-source-989f8b8dc-jtpjz\" (UID: \"601926a3-d0eb-48ae-b39c-bb878447f030\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jtpjz"
Jul 02 23:11:27.470398 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.470375    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnbvg\" (UniqueName: \"kubernetes.io/projected/19854b9a-bf87-470b-8247-726cf8e416a9-kube-api-access-bnbvg\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:27.471333 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.471141    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtz8n\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-kube-api-access-jtz8n\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:27.471729 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.471712    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49nv7\" (UniqueName: \"kubernetes.io/projected/a3f9c3bd-e3f0-4b40-885e-568e2fe525ba-kube-api-access-49nv7\") pod \"kube-storage-version-migrator-operator-846bf668f7-bgzln\" (UID: \"a3f9c3bd-e3f0-4b40-885e-568e2fe525ba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln"
Jul 02 23:11:27.474830 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.474812    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pzkxh_03629f7d-15f4-4e0c-931c-fbcb131fa7c3/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:27.486795 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.486775    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8"
Jul 02 23:11:27.553801 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.553538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln"
Jul 02 23:11:27.562004 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.561971    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jtpjz"
Jul 02 23:11:27.567632 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.567464    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jhbxf"
Jul 02 23:11:27.650147 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.649834    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8"]
Jul 02 23:11:27.730833 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.730800    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln"]
Jul 02 23:11:27.744552 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.744511    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-jtpjz"]
Jul 02 23:11:27.749423 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.749402    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jhbxf"]
Jul 02 23:11:27.879866 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.879821    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:27.879866 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.879844    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:27.880109 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.879821    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:27.883423 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.883388    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-872wr\""
Jul 02 23:11:27.883596 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.883577    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 23:11:27.883805 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.883751    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 23:11:27.884077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.884057    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qmzc5\""
Jul 02 23:11:27.958776 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:27.958746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:27.958912 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.958887    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:11:27.958988 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:27.958972    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls podName:19854b9a-bf87-470b-8247-726cf8e416a9 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:28.9589519 +0000 UTC m=+37.583370273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls") pod "dns-default-25fl5" (UID: "19854b9a-bf87-470b-8247-726cf8e416a9") : secret "dns-default-metrics-tls" not found
Jul 02 23:11:28.008161 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.008135    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-krsfl\""
Jul 02 23:11:28.051614 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.051585    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 02 23:11:28.053499 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.053481    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 23:11:28.058997 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.058980    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9874c716-714c-46b7-a814-a4634c608e26-serving-cert\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:28.091076 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.091055    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 02 23:11:28.092001 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.091985    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 02 23:11:28.094188 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.094166    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 23:11:28.094259 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.094237    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls podName:8fe31884-e666-46fd-a2c2-d99a9bd43fa7 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:28.594216847 +0000 UTC m=+37.218635217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ppkff" (UID: "8fe31884-e666-46fd-a2c2-d99a9bd43fa7") : secret "samples-operator-tls" not found
Jul 02 23:11:28.109396 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.109375    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ljjlr\""
Jul 02 23:11:28.116630 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.116614    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 02 23:11:28.125822 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.125804    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 23:11:28.125905 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.125888    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls podName:bd26f6f0-1585-45d3-8b38-c8fed2255d7e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:28.625866023 +0000 UTC m=+37.250284384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7tlln" (UID: "bd26f6f0-1585-45d3-8b38-c8fed2255d7e") : secret "cluster-monitoring-operator-tls" not found
Jul 02 23:11:28.134646 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.134630    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 02 23:11:28.134812 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.134800    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 23:11:28.134862 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.134851    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs podName:44bb06c8-7187-4452-9d34-7d8094f61e3c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:28.63483276 +0000 UTC m=+37.259251114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs") pod "router-default-6bf5644d8f-z2hn2" (UID: "44bb06c8-7187-4452-9d34-7d8094f61e3c") : secret "router-metrics-certs-default" not found
Jul 02 23:11:28.175651 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.175596    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-r9chl\""
Jul 02 23:11:28.175651 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.175600    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lz7qd\""
Jul 02 23:11:28.179998 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.179982    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-75ddl\""
Jul 02 23:11:28.214569 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.214550    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 23:11:28.215608 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.215590    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 23:11:28.224280 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.224257    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:11:28.224280 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.224277    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86677c8bd8-rsngf: secret "image-registry-tls" not found
Jul 02 23:11:28.224403 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.224333    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls podName:a16baa0f-554a-469b-a393-d447c0bae9f2 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:28.724314196 +0000 UTC m=+37.348732550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls") pod "image-registry-86677c8bd8-rsngf" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2") : secret "image-registry-tls" not found
Jul 02 23:11:28.224687 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.224667    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 23:11:28.240633 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.240609    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 02 23:11:28.246368 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.246349    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle podName:44bb06c8-7187-4452-9d34-7d8094f61e3c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:28.746333975 +0000 UTC m=+37.370752329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle") pod "router-default-6bf5644d8f-z2hn2" (UID: "44bb06c8-7187-4452-9d34-7d8094f61e3c") : configmap references non-existent config key: service-ca.crt
Jul 02 23:11:28.280102 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.280081    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 02 23:11:28.282318 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.282298    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:11:28.286070 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.286053    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4jfg\" (UniqueName: \"kubernetes.io/projected/823999b1-3441-46f4-bc9b-d4fea707df74-kube-api-access-p4jfg\") pod \"console-operator-68b757fb67-8jdxr\" (UID: \"823999b1-3441-46f4-bc9b-d4fea707df74\") " pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:28.286829 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.286811    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-default-certificate\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:28.289927 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.289896    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 02 23:11:28.295026 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.295009    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/823999b1-3441-46f4-bc9b-d4fea707df74-config\") pod \"console-operator-68b757fb67-8jdxr\" (UID: \"823999b1-3441-46f4-bc9b-d4fea707df74\") " pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:28.310152 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.310131    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 02 23:11:28.314714 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.314691    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 02 23:11:28.322337 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.322321    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 02 23:11:28.326147 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.326127    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9874c716-714c-46b7-a814-a4634c608e26-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:28.367274 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.367250    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 23:11:28.374752 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.374732    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a16baa0f-554a-469b-a393-d447c0bae9f2-trusted-ca\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:28.423015 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.422993    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:11:28.435382 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.435334    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgcrc\" (UniqueName: \"kubernetes.io/projected/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-kube-api-access-vgcrc\") pod \"cluster-samples-operator-56fcf86bf-ppkff\" (UID: \"8fe31884-e666-46fd-a2c2-d99a9bd43fa7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"
Jul 02 23:11:28.453882 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.453860    2563 configmap.go:193] Couldn't get configMap openshift-monitoring/telemetry-config: failed to sync configmap cache: timed out waiting for the condition
Jul 02 23:11:28.453997 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.453886    2563 configmap.go:193] Couldn't get configMap openshift-insights/trusted-ca-bundle: failed to sync configmap cache: timed out waiting for the condition
Jul 02 23:11:28.453997 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.453908    2563 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-private-configuration: failed to sync secret cache: timed out waiting for the condition
Jul 02 23:11:28.453997 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.453867    2563 configmap.go:193] Couldn't get configMap openshift-console-operator/trusted-ca: failed to sync configmap cache: timed out waiting for the condition
Jul 02 23:11:28.453997 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.453945    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-telemetry-config podName:bd26f6f0-1585-45d3-8b38-c8fed2255d7e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:28.953926785 +0000 UTC m=+37.578345153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "telemetry-config" (UniqueName: "kubernetes.io/configmap/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-telemetry-config") pod "cluster-monitoring-operator-64786d9cbb-7tlln" (UID: "bd26f6f0-1585-45d3-8b38-c8fed2255d7e") : failed to sync configmap cache: timed out waiting for the condition
Jul 02 23:11:28.453997 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.453973    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-image-registry-private-configuration podName:a16baa0f-554a-469b-a393-d447c0bae9f2 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:28.953957471 +0000 UTC m=+37.578375833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "image-registry-private-configuration" (UniqueName: "kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-image-registry-private-configuration") pod "image-registry-86677c8bd8-rsngf" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2") : failed to sync secret cache: timed out waiting for the condition
Jul 02 23:11:28.453997 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.453993    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/823999b1-3441-46f4-bc9b-d4fea707df74-trusted-ca podName:823999b1-3441-46f4-bc9b-d4fea707df74 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:28.953982854 +0000 UTC m=+37.578401208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "trusted-ca" (UniqueName: "kubernetes.io/configmap/823999b1-3441-46f4-bc9b-d4fea707df74-trusted-ca") pod "console-operator-68b757fb67-8jdxr" (UID: "823999b1-3441-46f4-bc9b-d4fea707df74") : failed to sync configmap cache: timed out waiting for the condition
Jul 02 23:11:28.454294 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.454008    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9874c716-714c-46b7-a814-a4634c608e26-trusted-ca-bundle podName:9874c716-714c-46b7-a814-a4634c608e26 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:28.953999604 +0000 UTC m=+37.578417962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/9874c716-714c-46b7-a814-a4634c608e26-trusted-ca-bundle") pod "insights-operator-5c847dcfc4-bw4cj" (UID: "9874c716-714c-46b7-a814-a4634c608e26") : failed to sync configmap cache: timed out waiting for the condition
Jul 02 23:11:28.456090 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.456020    2563 secret.go:189] Couldn't get secret openshift-image-registry/installation-pull-secrets: failed to sync secret cache: timed out waiting for the condition
Jul 02 23:11:28.456090 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.456041    2563 secret.go:189] Couldn't get secret openshift-ingress/router-stats-default: failed to sync secret cache: timed out waiting for the condition
Jul 02 23:11:28.456090 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.456051    2563 secret.go:189] Couldn't get secret openshift-console-operator/serving-cert: failed to sync secret cache: timed out waiting for the condition
Jul 02 23:11:28.456277 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.456097    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-stats-auth podName:44bb06c8-7187-4452-9d34-7d8094f61e3c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:28.956083336 +0000 UTC m=+37.580501696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "stats-auth" (UniqueName: "kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-stats-auth") pod "router-default-6bf5644d8f-z2hn2" (UID: "44bb06c8-7187-4452-9d34-7d8094f61e3c") : failed to sync secret cache: timed out waiting for the condition
Jul 02 23:11:28.456277 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.456116    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/823999b1-3441-46f4-bc9b-d4fea707df74-serving-cert podName:823999b1-3441-46f4-bc9b-d4fea707df74 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:28.956104832 +0000 UTC m=+37.580523186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/823999b1-3441-46f4-bc9b-d4fea707df74-serving-cert") pod "console-operator-68b757fb67-8jdxr" (UID: "823999b1-3441-46f4-bc9b-d4fea707df74") : failed to sync secret cache: timed out waiting for the condition
Jul 02 23:11:28.456277 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.456139    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-installation-pull-secrets podName:a16baa0f-554a-469b-a393-d447c0bae9f2 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:28.956130737 +0000 UTC m=+37.580549094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "installation-pull-secrets" (UniqueName: "kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-installation-pull-secrets") pod "image-registry-86677c8bd8-rsngf" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2") : failed to sync secret cache: timed out waiting for the condition
Jul 02 23:11:28.486412 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.486390    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 23:11:28.494794 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.494772    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq26k\" (UniqueName: \"kubernetes.io/projected/9874c716-714c-46b7-a814-a4634c608e26-kube-api-access-cq26k\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:28.500393 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.500376    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 23:11:28.557376 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.557352    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 23:11:28.564411 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.564377    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2xxk\" (UniqueName: \"kubernetes.io/projected/44bb06c8-7187-4452-9d34-7d8094f61e3c-kube-api-access-v2xxk\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:28.606969 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.606941    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 02 23:11:28.607239 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.607221    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 23:11:28.663974 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.663951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppkff\" (UID: \"8fe31884-e666-46fd-a2c2-d99a9bd43fa7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"
Jul 02 23:11:28.664132 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.664000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:28.664132 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.664027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:28.664132 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.664102    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 23:11:28.664296 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.664139    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 23:11:28.664296 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.664169    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 23:11:28.664296 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.664172    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls podName:8fe31884-e666-46fd-a2c2-d99a9bd43fa7 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:29.664151867 +0000 UTC m=+38.288570298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ppkff" (UID: "8fe31884-e666-46fd-a2c2-d99a9bd43fa7") : secret "samples-operator-tls" not found
Jul 02 23:11:28.664296 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.664229    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls podName:bd26f6f0-1585-45d3-8b38-c8fed2255d7e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:29.664212586 +0000 UTC m=+38.288630955 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7tlln" (UID: "bd26f6f0-1585-45d3-8b38-c8fed2255d7e") : secret "cluster-monitoring-operator-tls" not found
Jul 02 23:11:28.664296 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.664245    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs podName:44bb06c8-7187-4452-9d34-7d8094f61e3c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:29.66423489 +0000 UTC m=+38.288653248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs") pod "router-default-6bf5644d8f-z2hn2" (UID: "44bb06c8-7187-4452-9d34-7d8094f61e3c") : secret "router-metrics-certs-default" not found
Jul 02 23:11:28.668701 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.668683    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 02 23:11:28.688114 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.688065    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 02 23:11:28.703091 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.703073    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kcbnf\""
Jul 02 23:11:28.706595 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.706578    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 23:11:28.715602 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.715583    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cntz2\" (UniqueName: \"kubernetes.io/projected/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-kube-api-access-cntz2\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:28.732661 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.732641    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:11:28.745613 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.745590    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlwh9\" (UniqueName: \"kubernetes.io/projected/67181f51-bec1-45d0-a1a5-f60f25e7d392-kube-api-access-mlwh9\") pod \"volume-data-source-validator-5d456fdbcd-74p9r\" (UID: \"67181f51-bec1-45d0-a1a5-f60f25e7d392\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-74p9r"
Jul 02 23:11:28.761387 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.761369    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8ws2s\""
Jul 02 23:11:28.764557 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.764536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:28.764661 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.764652    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:11:28.764720 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.764668    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86677c8bd8-rsngf: secret "image-registry-tls" not found
Jul 02 23:11:28.764720 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.764686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:28.764818 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.764732    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls podName:a16baa0f-554a-469b-a393-d447c0bae9f2 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:29.7647107 +0000 UTC m=+38.389129067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls") pod "image-registry-86677c8bd8-rsngf" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2") : secret "image-registry-tls" not found
Jul 02 23:11:28.764862 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.764828    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle podName:44bb06c8-7187-4452-9d34-7d8094f61e3c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:29.764811584 +0000 UTC m=+38.389229940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle") pod "router-default-6bf5644d8f-z2hn2" (UID: "44bb06c8-7187-4452-9d34-7d8094f61e3c") : configmap references non-existent config key: service-ca.crt
Jul 02 23:11:28.767221 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.767190    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 02 23:11:28.782320 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.782294    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 02 23:11:28.862628 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.862597    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-67phh"]
Jul 02 23:11:28.865993 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.865972    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh"
Jul 02 23:11:28.868904 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.868878    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 02 23:11:28.869042 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.869004    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lzhrg\""
Jul 02 23:11:28.869172 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.869150    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 02 23:11:28.875781 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.875763    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-67phh"]
Jul 02 23:11:28.967440 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.967361    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/823999b1-3441-46f4-bc9b-d4fea707df74-serving-cert\") pod \"console-operator-68b757fb67-8jdxr\" (UID: \"823999b1-3441-46f4-bc9b-d4fea707df74\") " pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:28.967605 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.967527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/823999b1-3441-46f4-bc9b-d4fea707df74-trusted-ca\") pod \"console-operator-68b757fb67-8jdxr\" (UID: \"823999b1-3441-46f4-bc9b-d4fea707df74\") " pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:28.967605 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.967574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:28.967605 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.967600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9874c716-714c-46b7-a814-a4634c608e26-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:28.967808 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.967627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:28.967808 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.967655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-image-registry-private-configuration\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:28.967808 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.967688    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:11:28.967808 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:28.967772    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls podName:19854b9a-bf87-470b-8247-726cf8e416a9 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:30.967751599 +0000 UTC m=+39.592169958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls") pod "dns-default-25fl5" (UID: "19854b9a-bf87-470b-8247-726cf8e416a9") : secret "dns-default-metrics-tls" not found
Jul 02 23:11:28.968019 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.967690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/10b07ca3-e57c-4169-998a-2351dc0dcf1d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-67phh\" (UID: \"10b07ca3-e57c-4169-998a-2351dc0dcf1d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh"
Jul 02 23:11:28.968019 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.967999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-67phh\" (UID: \"10b07ca3-e57c-4169-998a-2351dc0dcf1d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh"
Jul 02 23:11:28.968114 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.968064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-installation-pull-secrets\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:28.968180 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.968110    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-stats-auth\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:28.968486 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.968439    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:28.968486 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.968476    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/823999b1-3441-46f4-bc9b-d4fea707df74-trusted-ca\") pod \"console-operator-68b757fb67-8jdxr\" (UID: \"823999b1-3441-46f4-bc9b-d4fea707df74\") " pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:28.968654 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.968507    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9874c716-714c-46b7-a814-a4634c608e26-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-bw4cj\" (UID: \"9874c716-714c-46b7-a814-a4634c608e26\") " pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:28.970676 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.970655    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/823999b1-3441-46f4-bc9b-d4fea707df74-serving-cert\") pod \"console-operator-68b757fb67-8jdxr\" (UID: \"823999b1-3441-46f4-bc9b-d4fea707df74\") " pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:28.970784 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.970657    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-installation-pull-secrets\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:28.970989 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.970973    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-image-registry-private-configuration\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:28.971051 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.971008    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-stats-auth\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:28.994545 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:28.994512    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-74p9r"
Jul 02 23:11:29.005806 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.005783    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj"
Jul 02 23:11:29.046032 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.045994    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:29.069058 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.069028    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/10b07ca3-e57c-4169-998a-2351dc0dcf1d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-67phh\" (UID: \"10b07ca3-e57c-4169-998a-2351dc0dcf1d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh"
Jul 02 23:11:29.069198 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.069134    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-67phh\" (UID: \"10b07ca3-e57c-4169-998a-2351dc0dcf1d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh"
Jul 02 23:11:29.069311 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:29.069286    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 23:11:29.069389 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:29.069358    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert podName:10b07ca3-e57c-4169-998a-2351dc0dcf1d nodeName:}" failed. No retries permitted until 2026-07-02 23:11:29.569340404 +0000 UTC m=+38.193758757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-67phh" (UID: "10b07ca3-e57c-4169-998a-2351dc0dcf1d") : secret "networking-console-plugin-cert" not found
Jul 02 23:11:29.069680 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.069664    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/10b07ca3-e57c-4169-998a-2351dc0dcf1d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-67phh\" (UID: \"10b07ca3-e57c-4169-998a-2351dc0dcf1d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh"
Jul 02 23:11:29.095444 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.095403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pzkxh_03629f7d-15f4-4e0c-931c-fbcb131fa7c3/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:29.115611 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:11:29.115583    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601926a3_d0eb_48ae_b39c_bb878447f030.slice/crio-702c4c3d4a070025fbb408207eee85853c823ec5f98d24acdd7c9c2595de1741 WatchSource:0}: Error finding container 702c4c3d4a070025fbb408207eee85853c823ec5f98d24acdd7c9c2595de1741: Status 404 returned error can't find the container with id 702c4c3d4a070025fbb408207eee85853c823ec5f98d24acdd7c9c2595de1741
Jul 02 23:11:29.116225 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:11:29.116192    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53af15b8_273e_497b_8923_ef7a99665e48.slice/crio-69db3623aacae2ead71a8be5db2c875eb670516300cfe6613837a0b847f846d5 WatchSource:0}: Error finding container 69db3623aacae2ead71a8be5db2c875eb670516300cfe6613837a0b847f846d5: Status 404 returned error can't find the container with id 69db3623aacae2ead71a8be5db2c875eb670516300cfe6613837a0b847f846d5
Jul 02 23:11:29.117129 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:11:29.117114    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef3f2606_899f_4946_b1b5_9bc4b8b5c2ad.slice/crio-00eec6756aafb7902f657bb433cb38840bdd5c1f6640620b18c08ee4469af4c4 WatchSource:0}: Error finding container 00eec6756aafb7902f657bb433cb38840bdd5c1f6640620b18c08ee4469af4c4: Status 404 returned error can't find the container with id 00eec6756aafb7902f657bb433cb38840bdd5c1f6640620b18c08ee4469af4c4
Jul 02 23:11:29.118262 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:11:29.118236    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f9c3bd_e3f0_4b40_885e_568e2fe525ba.slice/crio-b044d2b26a473fda91deeafbf6cf8fd11a2943316afa2b5e2ba66a514a4240f3 WatchSource:0}: Error finding container b044d2b26a473fda91deeafbf6cf8fd11a2943316afa2b5e2ba66a514a4240f3: Status 404 returned error can't find the container with id b044d2b26a473fda91deeafbf6cf8fd11a2943316afa2b5e2ba66a514a4240f3
Jul 02 23:11:29.166559 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.166527    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jhbxf" event={"ID":"53af15b8-273e-497b-8923-ef7a99665e48","Type":"ContainerStarted","Data":"69db3623aacae2ead71a8be5db2c875eb670516300cfe6613837a0b847f846d5"}
Jul 02 23:11:29.167692 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.167666    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln" event={"ID":"a3f9c3bd-e3f0-4b40-885e-568e2fe525ba","Type":"ContainerStarted","Data":"b044d2b26a473fda91deeafbf6cf8fd11a2943316afa2b5e2ba66a514a4240f3"}
Jul 02 23:11:29.168910 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.168860    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jtpjz" event={"ID":"601926a3-d0eb-48ae-b39c-bb878447f030","Type":"ContainerStarted","Data":"702c4c3d4a070025fbb408207eee85853c823ec5f98d24acdd7c9c2595de1741"}
Jul 02 23:11:29.172784 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.172727    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8" event={"ID":"ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad","Type":"ContainerStarted","Data":"00eec6756aafb7902f657bb433cb38840bdd5c1f6640620b18c08ee4469af4c4"}
Jul 02 23:11:29.193807 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.193707    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pzkxh_03629f7d-15f4-4e0c-931c-fbcb131fa7c3/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:29.276656 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.276631    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-bw4cj"]
Jul 02 23:11:29.279618 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:11:29.279591    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9874c716_714c_46b7_a814_a4634c608e26.slice/crio-c46bdca83d4a75c468b9a8deb9d3ed5e8c6b1091ee0c39f41d0f2e97cb010485 WatchSource:0}: Error finding container c46bdca83d4a75c468b9a8deb9d3ed5e8c6b1091ee0c39f41d0f2e97cb010485: Status 404 returned error can't find the container with id c46bdca83d4a75c468b9a8deb9d3ed5e8c6b1091ee0c39f41d0f2e97cb010485
Jul 02 23:11:29.290009 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.289977    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-74p9r"]
Jul 02 23:11:29.291602 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.291581    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-8jdxr"]
Jul 02 23:11:29.293688 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:11:29.293658    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67181f51_bec1_45d0_a1a5_f60f25e7d392.slice/crio-eb8766e580beab3d7536561549912c5860fd9cdf2147e217c39d7f369c53a070 WatchSource:0}: Error finding container eb8766e580beab3d7536561549912c5860fd9cdf2147e217c39d7f369c53a070: Status 404 returned error can't find the container with id eb8766e580beab3d7536561549912c5860fd9cdf2147e217c39d7f369c53a070
Jul 02 23:11:29.295528 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:11:29.295510    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod823999b1_3441_46f4_bc9b_d4fea707df74.slice/crio-5dc0bf7bcbddbf264fe07d684c44ca9639e2b9feb294a91318fe0bfd86243233 WatchSource:0}: Error finding container 5dc0bf7bcbddbf264fe07d684c44ca9639e2b9feb294a91318fe0bfd86243233: Status 404 returned error can't find the container with id 5dc0bf7bcbddbf264fe07d684c44ca9639e2b9feb294a91318fe0bfd86243233
Jul 02 23:11:29.575459 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.575379    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-67phh\" (UID: \"10b07ca3-e57c-4169-998a-2351dc0dcf1d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh"
Jul 02 23:11:29.575591 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:29.575506    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 23:11:29.575591 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:29.575572    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert podName:10b07ca3-e57c-4169-998a-2351dc0dcf1d nodeName:}" failed. No retries permitted until 2026-07-02 23:11:30.575553711 +0000 UTC m=+39.199972064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-67phh" (UID: "10b07ca3-e57c-4169-998a-2351dc0dcf1d") : secret "networking-console-plugin-cert" not found
Jul 02 23:11:29.676035 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.675999    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppkff\" (UID: \"8fe31884-e666-46fd-a2c2-d99a9bd43fa7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"
Jul 02 23:11:29.676225 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.676138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:29.676225 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.676169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:29.676225 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:29.676209    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 23:11:29.676371 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:29.676270    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls podName:8fe31884-e666-46fd-a2c2-d99a9bd43fa7 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:31.676252426 +0000 UTC m=+40.300670790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ppkff" (UID: "8fe31884-e666-46fd-a2c2-d99a9bd43fa7") : secret "samples-operator-tls" not found
Jul 02 23:11:29.676371 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:29.676288    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 23:11:29.676371 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:29.676305    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 23:11:29.676371 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:29.676319    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls podName:bd26f6f0-1585-45d3-8b38-c8fed2255d7e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:31.676309491 +0000 UTC m=+40.300727844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7tlln" (UID: "bd26f6f0-1585-45d3-8b38-c8fed2255d7e") : secret "cluster-monitoring-operator-tls" not found
Jul 02 23:11:29.676571 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:29.676387    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs podName:44bb06c8-7187-4452-9d34-7d8094f61e3c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:31.676365608 +0000 UTC m=+40.300783968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs") pod "router-default-6bf5644d8f-z2hn2" (UID: "44bb06c8-7187-4452-9d34-7d8094f61e3c") : secret "router-metrics-certs-default" not found
Jul 02 23:11:29.728383 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.728346    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pzkxh_03629f7d-15f4-4e0c-931c-fbcb131fa7c3/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:29.777266 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.777237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:29.777423 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:29.777412    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle podName:44bb06c8-7187-4452-9d34-7d8094f61e3c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:31.777391052 +0000 UTC m=+40.401809411 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle") pod "router-default-6bf5644d8f-z2hn2" (UID: "44bb06c8-7187-4452-9d34-7d8094f61e3c") : configmap references non-existent config key: service-ca.crt
Jul 02 23:11:29.777510 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.777495    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:29.777645 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:29.777625    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:11:29.777700 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:29.777650    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86677c8bd8-rsngf: secret "image-registry-tls" not found
Jul 02 23:11:29.777700 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:29.777696    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls podName:a16baa0f-554a-469b-a393-d447c0bae9f2 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:31.777681038 +0000 UTC m=+40.402099412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls") pod "image-registry-86677c8bd8-rsngf" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2") : secret "image-registry-tls" not found
Jul 02 23:11:29.828987 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:29.828937    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pzkxh_03629f7d-15f4-4e0c-931c-fbcb131fa7c3/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:30.188639 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:30.187542    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab285b66-20ac-4558-9ed4-900dd2e75ec3" containerID="372aa08cc1c8b5f688d3a8e6995e741e7d6e708b6393507c2d0b3c681e51a702" exitCode=0
Jul 02 23:11:30.188639 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:30.187734    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmpkm" event={"ID":"ab285b66-20ac-4558-9ed4-900dd2e75ec3","Type":"ContainerDied","Data":"372aa08cc1c8b5f688d3a8e6995e741e7d6e708b6393507c2d0b3c681e51a702"}
Jul 02 23:11:30.190979 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:30.190954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj" event={"ID":"9874c716-714c-46b7-a814-a4634c608e26","Type":"ContainerStarted","Data":"c46bdca83d4a75c468b9a8deb9d3ed5e8c6b1091ee0c39f41d0f2e97cb010485"}
Jul 02 23:11:30.193188 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:30.193117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr" event={"ID":"823999b1-3441-46f4-bc9b-d4fea707df74","Type":"ContainerStarted","Data":"5dc0bf7bcbddbf264fe07d684c44ca9639e2b9feb294a91318fe0bfd86243233"}
Jul 02 23:11:30.197524 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:30.197431    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-74p9r" event={"ID":"67181f51-bec1-45d0-a1a5-f60f25e7d392","Type":"ContainerStarted","Data":"eb8766e580beab3d7536561549912c5860fd9cdf2147e217c39d7f369c53a070"}
Jul 02 23:11:30.586514 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:30.586269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-67phh\" (UID: \"10b07ca3-e57c-4169-998a-2351dc0dcf1d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh"
Jul 02 23:11:30.595297 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:30.595269    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 23:11:30.595425 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:30.595360    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert podName:10b07ca3-e57c-4169-998a-2351dc0dcf1d nodeName:}" failed. No retries permitted until 2026-07-02 23:11:32.595338459 +0000 UTC m=+41.219756812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-67phh" (UID: "10b07ca3-e57c-4169-998a-2351dc0dcf1d") : secret "networking-console-plugin-cert" not found
Jul 02 23:11:30.990547 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:30.990499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:30.990736 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:30.990680    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:11:30.990799 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:30.990739    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls podName:19854b9a-bf87-470b-8247-726cf8e416a9 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:34.990722197 +0000 UTC m=+43.615140553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls") pod "dns-default-25fl5" (UID: "19854b9a-bf87-470b-8247-726cf8e416a9") : secret "dns-default-metrics-tls" not found
Jul 02 23:11:31.210025 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:31.209989    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab285b66-20ac-4558-9ed4-900dd2e75ec3" containerID="0872cdf16b3a8698347202e2b60887f45481430b8b2e86ea436030da5137a52d" exitCode=0
Jul 02 23:11:31.210457 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:31.210047    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmpkm" event={"ID":"ab285b66-20ac-4558-9ed4-900dd2e75ec3","Type":"ContainerDied","Data":"0872cdf16b3a8698347202e2b60887f45481430b8b2e86ea436030da5137a52d"}
Jul 02 23:11:31.571465 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:31.571358    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pzkxh_03629f7d-15f4-4e0c-931c-fbcb131fa7c3/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:31.698286 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:31.698251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:31.698475 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:31.698300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:31.698475 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:31.698370    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 23:11:31.698475 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:31.698422    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 23:11:31.698475 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:31.698449    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs podName:44bb06c8-7187-4452-9d34-7d8094f61e3c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:35.698426876 +0000 UTC m=+44.322845240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs") pod "router-default-6bf5644d8f-z2hn2" (UID: "44bb06c8-7187-4452-9d34-7d8094f61e3c") : secret "router-metrics-certs-default" not found
Jul 02 23:11:31.698696 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:31.698517    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls podName:bd26f6f0-1585-45d3-8b38-c8fed2255d7e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:35.698497431 +0000 UTC m=+44.322915789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7tlln" (UID: "bd26f6f0-1585-45d3-8b38-c8fed2255d7e") : secret "cluster-monitoring-operator-tls" not found
Jul 02 23:11:31.698696 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:31.698560    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppkff\" (UID: \"8fe31884-e666-46fd-a2c2-d99a9bd43fa7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"
Jul 02 23:11:31.698696 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:31.698693    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 23:11:31.698852 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:31.698742    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls podName:8fe31884-e666-46fd-a2c2-d99a9bd43fa7 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:35.698729581 +0000 UTC m=+44.323147950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ppkff" (UID: "8fe31884-e666-46fd-a2c2-d99a9bd43fa7") : secret "samples-operator-tls" not found
Jul 02 23:11:31.782455 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:31.782384    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pzkxh_03629f7d-15f4-4e0c-931c-fbcb131fa7c3/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:31.799137 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:31.799106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:31.799273 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:31.799234    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:31.799328 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:31.799294    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle podName:44bb06c8-7187-4452-9d34-7d8094f61e3c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:35.799272075 +0000 UTC m=+44.423690429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle") pod "router-default-6bf5644d8f-z2hn2" (UID: "44bb06c8-7187-4452-9d34-7d8094f61e3c") : configmap references non-existent config key: service-ca.crt
Jul 02 23:11:31.799384 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:31.799357    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:11:31.799384 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:31.799371    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86677c8bd8-rsngf: secret "image-registry-tls" not found
Jul 02 23:11:31.799467 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:31.799415    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls podName:a16baa0f-554a-469b-a393-d447c0bae9f2 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:35.799400256 +0000 UTC m=+44.423818628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls") pod "image-registry-86677c8bd8-rsngf" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2") : secret "image-registry-tls" not found
Jul 02 23:11:31.884039 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:31.884006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pzkxh_03629f7d-15f4-4e0c-931c-fbcb131fa7c3/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:32.606822 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:32.606783    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-67phh\" (UID: \"10b07ca3-e57c-4169-998a-2351dc0dcf1d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh"
Jul 02 23:11:32.607270 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:32.606954    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 23:11:32.607270 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:32.607039    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert podName:10b07ca3-e57c-4169-998a-2351dc0dcf1d nodeName:}" failed. No retries permitted until 2026-07-02 23:11:36.607021895 +0000 UTC m=+45.231440252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-67phh" (UID: "10b07ca3-e57c-4169-998a-2351dc0dcf1d") : secret "networking-console-plugin-cert" not found
Jul 02 23:11:33.632989 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:33.632956    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pzkxh_03629f7d-15f4-4e0c-931c-fbcb131fa7c3/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:33.743166 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:33.743133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pzkxh_03629f7d-15f4-4e0c-931c-fbcb131fa7c3/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:34.332289 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:34.332250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pzkxh_03629f7d-15f4-4e0c-931c-fbcb131fa7c3/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:34.443190 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:34.443154    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pzkxh_03629f7d-15f4-4e0c-931c-fbcb131fa7c3/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:35.029529 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:35.029501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:35.029883 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:35.029643    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:11:35.029883 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:35.029700    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls podName:19854b9a-bf87-470b-8247-726cf8e416a9 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:43.029685806 +0000 UTC m=+51.654104159 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls") pod "dns-default-25fl5" (UID: "19854b9a-bf87-470b-8247-726cf8e416a9") : secret "dns-default-metrics-tls" not found
Jul 02 23:11:35.734910 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:35.734874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppkff\" (UID: \"8fe31884-e666-46fd-a2c2-d99a9bd43fa7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"
Jul 02 23:11:35.735114 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:35.734955    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:35.735114 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:35.734988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:35.735114 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:35.735026    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 23:11:35.735114 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:35.735070    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 23:11:35.735114 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:35.735087    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls podName:8fe31884-e666-46fd-a2c2-d99a9bd43fa7 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:43.735069737 +0000 UTC m=+52.359488109 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ppkff" (UID: "8fe31884-e666-46fd-a2c2-d99a9bd43fa7") : secret "samples-operator-tls" not found
Jul 02 23:11:35.735114 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:35.735092    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 23:11:35.735441 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:35.735104    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls podName:bd26f6f0-1585-45d3-8b38-c8fed2255d7e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:43.735094006 +0000 UTC m=+52.359512361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7tlln" (UID: "bd26f6f0-1585-45d3-8b38-c8fed2255d7e") : secret "cluster-monitoring-operator-tls" not found
Jul 02 23:11:35.735441 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:35.735165    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs podName:44bb06c8-7187-4452-9d34-7d8094f61e3c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:43.735148753 +0000 UTC m=+52.359567106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs") pod "router-default-6bf5644d8f-z2hn2" (UID: "44bb06c8-7187-4452-9d34-7d8094f61e3c") : secret "router-metrics-certs-default" not found
Jul 02 23:11:35.836345 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:35.836307    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:35.836518 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:35.836397    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:35.836518 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:35.836495    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:11:35.836518 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:35.836518    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86677c8bd8-rsngf: secret "image-registry-tls" not found
Jul 02 23:11:35.836670 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:35.836584    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle podName:44bb06c8-7187-4452-9d34-7d8094f61e3c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:43.836565995 +0000 UTC m=+52.460984351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle") pod "router-default-6bf5644d8f-z2hn2" (UID: "44bb06c8-7187-4452-9d34-7d8094f61e3c") : configmap references non-existent config key: service-ca.crt
Jul 02 23:11:35.836670 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:35.836610    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls podName:a16baa0f-554a-469b-a393-d447c0bae9f2 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:43.836600792 +0000 UTC m=+52.461019149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls") pod "image-registry-86677c8bd8-rsngf" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2") : secret "image-registry-tls" not found
Jul 02 23:11:36.643894 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:36.643870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-67phh\" (UID: \"10b07ca3-e57c-4169-998a-2351dc0dcf1d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh"
Jul 02 23:11:36.644247 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:36.644063    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 23:11:36.644247 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:36.644130    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert podName:10b07ca3-e57c-4169-998a-2351dc0dcf1d nodeName:}" failed. No retries permitted until 2026-07-02 23:11:44.644104483 +0000 UTC m=+53.268522840 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-67phh" (UID: "10b07ca3-e57c-4169-998a-2351dc0dcf1d") : secret "networking-console-plugin-cert" not found
Jul 02 23:11:37.227076 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.227001    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8" event={"ID":"ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad","Type":"ContainerStarted","Data":"930daa0dc62fa77a22f2993a4b761340f4cbc4d7927753ce72b46beab4f0fa04"}
Jul 02 23:11:37.229651 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.229625    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/0.log"
Jul 02 23:11:37.229780 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.229666    2563 generic.go:356] "Generic (PLEG): container finished" podID="823999b1-3441-46f4-bc9b-d4fea707df74" containerID="f3bc6e3c57b7f90944acd949865654088058402adce38fff31217e91fc2cac56" exitCode=255
Jul 02 23:11:37.229780 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.229739    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr" event={"ID":"823999b1-3441-46f4-bc9b-d4fea707df74","Type":"ContainerDied","Data":"f3bc6e3c57b7f90944acd949865654088058402adce38fff31217e91fc2cac56"}
Jul 02 23:11:37.229948 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.229908    2563 scope.go:117] "RemoveContainer" containerID="f3bc6e3c57b7f90944acd949865654088058402adce38fff31217e91fc2cac56"
Jul 02 23:11:37.232065 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.232039    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-74p9r" event={"ID":"67181f51-bec1-45d0-a1a5-f60f25e7d392","Type":"ContainerStarted","Data":"53558dda2ff009774dac8442e002e5c305e832a5980213751fd733958bc54801"}
Jul 02 23:11:37.235883 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.235840    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mmpkm" event={"ID":"ab285b66-20ac-4558-9ed4-900dd2e75ec3","Type":"ContainerStarted","Data":"2419385fdd7de59c1ea079b830e71a9a1cf13cd0f8236ab75be3c112eef1426f"}
Jul 02 23:11:37.240078 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.237506    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jhbxf" event={"ID":"53af15b8-273e-497b-8923-ef7a99665e48","Type":"ContainerStarted","Data":"3bfc0d86bcba5bc56fbf06bdb306fb9d710f4827b26040d0200ebcc67a450cfd"}
Jul 02 23:11:37.240078 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.239335    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln" event={"ID":"a3f9c3bd-e3f0-4b40-885e-568e2fe525ba","Type":"ContainerStarted","Data":"6c815328ef1f26ea6d87ef49f2eeadeed1560db17c17452bb51ecc6c6f1470fb"}
Jul 02 23:11:37.240881 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.240856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj" event={"ID":"9874c716-714c-46b7-a814-a4634c608e26","Type":"ContainerStarted","Data":"79ba6370c92c2f4404684d348e9ee0a23aa0cfe7c44293c154f8f014af913dcf"}
Jul 02 23:11:37.242686 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.242662    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jtpjz" event={"ID":"601926a3-d0eb-48ae-b39c-bb878447f030","Type":"ContainerStarted","Data":"420cc66b2611c391ba15002e7703ba0bc592aa89be8a9617c16d9387d2bb22df"}
Jul 02 23:11:37.263332 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.263280    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8" podStartSLOduration=3.889055905 podStartE2EDuration="11.263267487s" totalImagesPullingTime="7.374211582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:37.261653339 +0000 UTC m=+45.886071712" watchObservedRunningTime="2026-07-02 23:11:37.263267487 +0000 UTC m=+45.887685841"
Jul 02 23:11:37.286752 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.286614    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-jtpjz" podStartSLOduration=3.600169351 podStartE2EDuration="11.286597833s" totalImagesPullingTime="7.686428482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:37.284702266 +0000 UTC m=+45.909120642" watchObservedRunningTime="2026-07-02 23:11:37.286597833 +0000 UTC m=+45.911016188"
Jul 02 23:11:37.309329 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.309281    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jhbxf" podStartSLOduration=2.926791133 podStartE2EDuration="10.309265055s" totalImagesPullingTime="7.382473922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:37.30922699 +0000 UTC m=+45.933645366" watchObservedRunningTime="2026-07-02 23:11:37.309265055 +0000 UTC m=+45.933683422"
Jul 02 23:11:37.333837 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.331751    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-74p9r" podStartSLOduration=5.16268656 podStartE2EDuration="12.331735425s" totalImagesPullingTime="7.169048865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:37.331491644 +0000 UTC m=+45.955910017" watchObservedRunningTime="2026-07-02 23:11:37.331735425 +0000 UTC m=+45.956153800"
Jul 02 23:11:37.394111 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.394058    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mmpkm" podStartSLOduration=13.676887545 podStartE2EDuration="44.394038184s" totalImagesPullingTime="30.717150639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:37.391874207 +0000 UTC m=+46.016292582" watchObservedRunningTime="2026-07-02 23:11:37.394038184 +0000 UTC m=+46.018456560"
Jul 02 23:11:37.419045 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:37.419006    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj" podStartSLOduration=5.204869915 podStartE2EDuration="12.41899241s" totalImagesPullingTime="7.214122495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:37.418197446 +0000 UTC m=+46.042615820" watchObservedRunningTime="2026-07-02 23:11:37.41899241 +0000 UTC m=+46.043410807"
Jul 02 23:11:38.249962 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.249910    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/1.log"
Jul 02 23:11:38.250359 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.250326    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/0.log"
Jul 02 23:11:38.250417 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.250357    2563 generic.go:356] "Generic (PLEG): container finished" podID="823999b1-3441-46f4-bc9b-d4fea707df74" containerID="44783351e424359f13210e7fb806a8546885610b2bfcf9e233d1f888ac06aa6b" exitCode=255
Jul 02 23:11:38.250492 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.250464    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr" event={"ID":"823999b1-3441-46f4-bc9b-d4fea707df74","Type":"ContainerDied","Data":"44783351e424359f13210e7fb806a8546885610b2bfcf9e233d1f888ac06aa6b"}
Jul 02 23:11:38.250617 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.250518    2563 scope.go:117] "RemoveContainer" containerID="f3bc6e3c57b7f90944acd949865654088058402adce38fff31217e91fc2cac56"
Jul 02 23:11:38.251391 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.250785    2563 scope.go:117] "RemoveContainer" containerID="44783351e424359f13210e7fb806a8546885610b2bfcf9e233d1f888ac06aa6b"
Jul 02 23:11:38.251391 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:38.250961    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8jdxr_openshift-console-operator(823999b1-3441-46f4-bc9b-d4fea707df74)\"" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr" podUID="823999b1-3441-46f4-bc9b-d4fea707df74"
Jul 02 23:11:38.288656 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.288616    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln" podStartSLOduration=4.914886507 podStartE2EDuration="12.288598234s" totalImagesPullingTime="7.373711727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:37.445994617 +0000 UTC m=+46.070412992" watchObservedRunningTime="2026-07-02 23:11:38.288598234 +0000 UTC m=+46.913016614"
Jul 02 23:11:38.475086 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.475054    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nmn8c"]
Jul 02 23:11:38.504083 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.504016    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nmn8c"]
Jul 02 23:11:38.504241 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.504097    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:38.507991 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.507955    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 23:11:38.507991 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.507962    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6w77h\""
Jul 02 23:11:38.508218 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.508038    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 23:11:38.565606 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.565580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:38.565762 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.565712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-crio-socket\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:38.565822 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.565775    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-data-volume\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:38.565822 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.565802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:38.565936 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.565847    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksp96\" (UniqueName: \"kubernetes.io/projected/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-api-access-ksp96\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:38.666237 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.666217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-crio-socket\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:38.666350 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.666243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-data-volume\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:38.666350 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.666265    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:38.666462 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.666409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksp96\" (UniqueName: \"kubernetes.io/projected/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-api-access-ksp96\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:38.666462 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.666436    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-crio-socket\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:38.666462 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.666454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:38.666612 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:38.666468    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:11:38.666612 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.666487    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-data-volume\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:38.666612 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:38.666549    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-rbac-proxy-cm podName:c68d2447-a88a-40ba-a9a3-82a40ef83b8f nodeName:}" failed. No retries permitted until 2026-07-02 23:11:39.166533467 +0000 UTC m=+47.790951824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nmn8c" (UID: "c68d2447-a88a-40ba-a9a3-82a40ef83b8f") : configmap "kube-rbac-proxy" not found
Jul 02 23:11:38.666612 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:38.666561    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:38.666833 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:38.666625    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls podName:c68d2447-a88a-40ba-a9a3-82a40ef83b8f nodeName:}" failed. No retries permitted until 2026-07-02 23:11:39.166610347 +0000 UTC m=+47.791028717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmn8c" (UID: "c68d2447-a88a-40ba-a9a3-82a40ef83b8f") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:38.679512 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:38.679490    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksp96\" (UniqueName: \"kubernetes.io/projected/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-api-access-ksp96\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:39.046139 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:39.046108    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:39.046296 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:39.046191    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:39.171554 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:39.171524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:39.171742 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:39.171585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:39.171742 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:39.171686    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:11:39.171742 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:39.171741    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-rbac-proxy-cm podName:c68d2447-a88a-40ba-a9a3-82a40ef83b8f nodeName:}" failed. No retries permitted until 2026-07-02 23:11:40.171725262 +0000 UTC m=+48.796143619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nmn8c" (UID: "c68d2447-a88a-40ba-a9a3-82a40ef83b8f") : configmap "kube-rbac-proxy" not found
Jul 02 23:11:39.171934 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:39.171803    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:39.171934 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:39.171865    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls podName:c68d2447-a88a-40ba-a9a3-82a40ef83b8f nodeName:}" failed. No retries permitted until 2026-07-02 23:11:40.171851921 +0000 UTC m=+48.796270274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmn8c" (UID: "c68d2447-a88a-40ba-a9a3-82a40ef83b8f") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:39.254306 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:39.254279    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/1.log"
Jul 02 23:11:39.254656 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:39.254583    2563 scope.go:117] "RemoveContainer" containerID="44783351e424359f13210e7fb806a8546885610b2bfcf9e233d1f888ac06aa6b"
Jul 02 23:11:39.254751 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:39.254734    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8jdxr_openshift-console-operator(823999b1-3441-46f4-bc9b-d4fea707df74)\"" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr" podUID="823999b1-3441-46f4-bc9b-d4fea707df74"
Jul 02 23:11:39.874417 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:39.874391    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-48c2d_98d4d36e-f535-4b18-bec3-f6e8057253c4/dns-node-resolver/0.log"
Jul 02 23:11:40.178683 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:40.178611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:40.178683 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:40.178666    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:40.178852 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:40.178729    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:11:40.178852 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:40.178756    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:40.178852 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:40.178795    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-rbac-proxy-cm podName:c68d2447-a88a-40ba-a9a3-82a40ef83b8f nodeName:}" failed. No retries permitted until 2026-07-02 23:11:42.178775903 +0000 UTC m=+50.803194260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nmn8c" (UID: "c68d2447-a88a-40ba-a9a3-82a40ef83b8f") : configmap "kube-rbac-proxy" not found
Jul 02 23:11:40.178852 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:40.178809    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls podName:c68d2447-a88a-40ba-a9a3-82a40ef83b8f nodeName:}" failed. No retries permitted until 2026-07-02 23:11:42.178803217 +0000 UTC m=+50.803221570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmn8c" (UID: "c68d2447-a88a-40ba-a9a3-82a40ef83b8f") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:40.258230 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:40.258209    2563 scope.go:117] "RemoveContainer" containerID="44783351e424359f13210e7fb806a8546885610b2bfcf9e233d1f888ac06aa6b"
Jul 02 23:11:40.258570 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:40.258341    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-8jdxr_openshift-console-operator(823999b1-3441-46f4-bc9b-d4fea707df74)\"" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr" podUID="823999b1-3441-46f4-bc9b-d4fea707df74"
Jul 02 23:11:41.074693 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:41.074670    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v69lx_2a588334-ee3c-4a30-a704-5e42f0dfae27/node-ca/0.log"
Jul 02 23:11:41.886057 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:41.886025    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jhbxf_53af15b8-273e-497b-8923-ef7a99665e48/serve-healthcheck-canary/0.log"
Jul 02 23:11:42.195659 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:42.195588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:42.195659 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:42.195653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:42.195866 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:42.195707    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:11:42.195866 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:42.195765    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-rbac-proxy-cm podName:c68d2447-a88a-40ba-a9a3-82a40ef83b8f nodeName:}" failed. No retries permitted until 2026-07-02 23:11:46.195750084 +0000 UTC m=+54.820168437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nmn8c" (UID: "c68d2447-a88a-40ba-a9a3-82a40ef83b8f") : configmap "kube-rbac-proxy" not found
Jul 02 23:11:42.195866 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:42.195807    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:42.195866 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:42.195861    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls podName:c68d2447-a88a-40ba-a9a3-82a40ef83b8f nodeName:}" failed. No retries permitted until 2026-07-02 23:11:46.195847276 +0000 UTC m=+54.820265641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmn8c" (UID: "c68d2447-a88a-40ba-a9a3-82a40ef83b8f") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:43.102772 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:43.102736    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:43.103153 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:43.102862    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:11:43.103153 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:43.102912    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls podName:19854b9a-bf87-470b-8247-726cf8e416a9 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:59.102899582 +0000 UTC m=+67.727317936 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls") pod "dns-default-25fl5" (UID: "19854b9a-bf87-470b-8247-726cf8e416a9") : secret "dns-default-metrics-tls" not found
Jul 02 23:11:43.809468 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:43.809438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppkff\" (UID: \"8fe31884-e666-46fd-a2c2-d99a9bd43fa7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"
Jul 02 23:11:43.809649 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:43.809486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:43.809649 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:43.809504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:43.809649 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:43.809580    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 23:11:43.809649 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:43.809595    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 23:11:43.809649 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:43.809639    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 23:11:43.809834 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:43.809642    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls podName:8fe31884-e666-46fd-a2c2-d99a9bd43fa7 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:59.809628545 +0000 UTC m=+68.434046903 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ppkff" (UID: "8fe31884-e666-46fd-a2c2-d99a9bd43fa7") : secret "samples-operator-tls" not found
Jul 02 23:11:43.809834 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:43.809682    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs podName:44bb06c8-7187-4452-9d34-7d8094f61e3c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:59.809669948 +0000 UTC m=+68.434088302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs") pod "router-default-6bf5644d8f-z2hn2" (UID: "44bb06c8-7187-4452-9d34-7d8094f61e3c") : secret "router-metrics-certs-default" not found
Jul 02 23:11:43.809834 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:43.809696    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls podName:bd26f6f0-1585-45d3-8b38-c8fed2255d7e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:59.809687583 +0000 UTC m=+68.434105937 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-7tlln" (UID: "bd26f6f0-1585-45d3-8b38-c8fed2255d7e") : secret "cluster-monitoring-operator-tls" not found
Jul 02 23:11:43.910102 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:43.910074    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:43.910236 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:43.910155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:43.910236 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:43.910207    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:11:43.910236 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:43.910226    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86677c8bd8-rsngf: secret "image-registry-tls" not found
Jul 02 23:11:43.910333 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:43.910258    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle podName:44bb06c8-7187-4452-9d34-7d8094f61e3c nodeName:}" failed. No retries permitted until 2026-07-02 23:11:59.910246229 +0000 UTC m=+68.534664583 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle") pod "router-default-6bf5644d8f-z2hn2" (UID: "44bb06c8-7187-4452-9d34-7d8094f61e3c") : configmap references non-existent config key: service-ca.crt
Jul 02 23:11:43.910333 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:43.910273    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls podName:a16baa0f-554a-469b-a393-d447c0bae9f2 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:59.910266585 +0000 UTC m=+68.534684938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls") pod "image-registry-86677c8bd8-rsngf" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2") : secret "image-registry-tls" not found
Jul 02 23:11:44.716215 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:44.716185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-67phh\" (UID: \"10b07ca3-e57c-4169-998a-2351dc0dcf1d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh"
Jul 02 23:11:44.716579 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:44.716300    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 23:11:44.716579 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:44.716363    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert podName:10b07ca3-e57c-4169-998a-2351dc0dcf1d nodeName:}" failed. No retries permitted until 2026-07-02 23:12:00.71634406 +0000 UTC m=+69.340762419 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-67phh" (UID: "10b07ca3-e57c-4169-998a-2351dc0dcf1d") : secret "networking-console-plugin-cert" not found
Jul 02 23:11:46.230164 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:46.230121    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:46.230597 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:46.230250    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:46.230597 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:46.230269    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:46.230597 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:46.230330    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls podName:c68d2447-a88a-40ba-a9a3-82a40ef83b8f nodeName:}" failed. No retries permitted until 2026-07-02 23:11:54.230312137 +0000 UTC m=+62.854730498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmn8c" (UID: "c68d2447-a88a-40ba-a9a3-82a40ef83b8f") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:11:46.230708 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:46.230655    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:53.166154 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:53.166130    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4gkxz"
Jul 02 23:11:54.297825 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:54.297784    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:54.300409 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:54.300383    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c68d2447-a88a-40ba-a9a3-82a40ef83b8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmn8c\" (UID: \"c68d2447-a88a-40ba-a9a3-82a40ef83b8f\") " pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:54.420221 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:54.420188    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6w77h\""
Jul 02 23:11:54.426170 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:54.426150    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nmn8c"
Jul 02 23:11:54.558703 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:54.558632    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nmn8c"]
Jul 02 23:11:54.561193 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:11:54.561170    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc68d2447_a88a_40ba_a9a3_82a40ef83b8f.slice/crio-a0f9f7b49fa669b22f79b5b06696937b1f4d43b6a9c4f098d1a912f40b77889d WatchSource:0}: Error finding container a0f9f7b49fa669b22f79b5b06696937b1f4d43b6a9c4f098d1a912f40b77889d: Status 404 returned error can't find the container with id a0f9f7b49fa669b22f79b5b06696937b1f4d43b6a9c4f098d1a912f40b77889d
Jul 02 23:11:54.880363 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:54.880330    2563 scope.go:117] "RemoveContainer" containerID="44783351e424359f13210e7fb806a8546885610b2bfcf9e233d1f888ac06aa6b"
Jul 02 23:11:55.307193 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:55.307168    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:11:55.307848 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:55.307822    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/1.log"
Jul 02 23:11:55.307974 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:55.307867    2563 generic.go:356] "Generic (PLEG): container finished" podID="823999b1-3441-46f4-bc9b-d4fea707df74" containerID="ae7e4270b55ec2e198554ffffdcf5d923bf94b6a4a5f31460b9cabe039ee31ae" exitCode=255
Jul 02 23:11:55.308046 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:55.307972    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr" event={"ID":"823999b1-3441-46f4-bc9b-d4fea707df74","Type":"ContainerDied","Data":"ae7e4270b55ec2e198554ffffdcf5d923bf94b6a4a5f31460b9cabe039ee31ae"}
Jul 02 23:11:55.308046 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:55.308025    2563 scope.go:117] "RemoveContainer" containerID="44783351e424359f13210e7fb806a8546885610b2bfcf9e233d1f888ac06aa6b"
Jul 02 23:11:55.308482 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:55.308463    2563 scope.go:117] "RemoveContainer" containerID="ae7e4270b55ec2e198554ffffdcf5d923bf94b6a4a5f31460b9cabe039ee31ae"
Jul 02 23:11:55.308676 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:55.308652    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-8jdxr_openshift-console-operator(823999b1-3441-46f4-bc9b-d4fea707df74)\"" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr" podUID="823999b1-3441-46f4-bc9b-d4fea707df74"
Jul 02 23:11:55.310486 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:55.310461    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmn8c" event={"ID":"c68d2447-a88a-40ba-a9a3-82a40ef83b8f","Type":"ContainerStarted","Data":"a0f9f7b49fa669b22f79b5b06696937b1f4d43b6a9c4f098d1a912f40b77889d"}
Jul 02 23:11:56.315311 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:56.315273    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:11:57.635591 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:57.635556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs\") pod \"network-metrics-daemon-stw2z\" (UID: \"b67810dc-1b52-4571-8430-9e1eb815d6e8\") " pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:57.639081 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:57.639054    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 23:11:57.649160 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:57.649135    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b67810dc-1b52-4571-8430-9e1eb815d6e8-metrics-certs\") pod \"network-metrics-daemon-stw2z\" (UID: \"b67810dc-1b52-4571-8430-9e1eb815d6e8\") " pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:57.736493 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:57.736457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:57.739975 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:57.739952    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 23:11:57.749532 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:57.749515    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/904dd94e-b420-4d10-a889-3dd86aecf071-original-pull-secret\") pod \"global-pull-secret-syncer-fjtpp\" (UID: \"904dd94e-b420-4d10-a889-3dd86aecf071\") " pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:57.837293 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:57.837258    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdj4v\" (UniqueName: \"kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v\") pod \"network-check-target-46nf6\" (UID: \"82141c32-ce33-4ece-b8af-7a5d455883a6\") " pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:57.839701 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:57.839678    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdj4v\" (UniqueName: \"kubernetes.io/projected/82141c32-ce33-4ece-b8af-7a5d455883a6-kube-api-access-jdj4v\") pod \"network-check-target-46nf6\" (UID: \"82141c32-ce33-4ece-b8af-7a5d455883a6\") " pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:57.892257 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:57.892187    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fjtpp"
Jul 02 23:11:57.902840 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:57.902816    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qmzc5\""
Jul 02 23:11:57.906440 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:57.906422    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-872wr\""
Jul 02 23:11:57.910402 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:57.910381    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:57.914163 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:57.914138    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-stw2z"
Jul 02 23:11:58.259198 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:58.259130    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fjtpp"]
Jul 02 23:11:58.262070 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:11:58.262047    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904dd94e_b420_4d10_a889_3dd86aecf071.slice/crio-e8f1df343b4e9dcb5becd80622dcb834c5bdd5fbe914466957f225e0ba930c67 WatchSource:0}: Error finding container e8f1df343b4e9dcb5becd80622dcb834c5bdd5fbe914466957f225e0ba930c67: Status 404 returned error can't find the container with id e8f1df343b4e9dcb5becd80622dcb834c5bdd5fbe914466957f225e0ba930c67
Jul 02 23:11:58.323708 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:58.323677    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmn8c" event={"ID":"c68d2447-a88a-40ba-a9a3-82a40ef83b8f","Type":"ContainerStarted","Data":"180114ec83aa67aad6bb4d8e5a7632d376cc719e7ab0da354036c967b6668019"}
Jul 02 23:11:58.324706 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:58.324683    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fjtpp" event={"ID":"904dd94e-b420-4d10-a889-3dd86aecf071","Type":"ContainerStarted","Data":"e8f1df343b4e9dcb5becd80622dcb834c5bdd5fbe914466957f225e0ba930c67"}
Jul 02 23:11:58.485648 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:58.485573    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-46nf6"]
Jul 02 23:11:58.488473 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:11:58.488446    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82141c32_ce33_4ece_b8af_7a5d455883a6.slice/crio-9ffa1655b1fda4d07e4cc2c12edfe451223a275fbddede11a900bf30694f028f WatchSource:0}: Error finding container 9ffa1655b1fda4d07e4cc2c12edfe451223a275fbddede11a900bf30694f028f: Status 404 returned error can't find the container with id 9ffa1655b1fda4d07e4cc2c12edfe451223a275fbddede11a900bf30694f028f
Jul 02 23:11:58.489285 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:58.489259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-stw2z"]
Jul 02 23:11:58.492890 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:11:58.492865    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb67810dc_1b52_4571_8430_9e1eb815d6e8.slice/crio-4f7e2d32c02dce85433593422f4b3ed7362060c5d99911744feaa4b675ebc70d WatchSource:0}: Error finding container 4f7e2d32c02dce85433593422f4b3ed7362060c5d99911744feaa4b675ebc70d: Status 404 returned error can't find the container with id 4f7e2d32c02dce85433593422f4b3ed7362060c5d99911744feaa4b675ebc70d
Jul 02 23:11:59.046728 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.046691    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:59.047326 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.046769    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:11:59.047326 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.047160    2563 scope.go:117] "RemoveContainer" containerID="ae7e4270b55ec2e198554ffffdcf5d923bf94b6a4a5f31460b9cabe039ee31ae"
Jul 02 23:11:59.047435 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:11:59.047364    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-8jdxr_openshift-console-operator(823999b1-3441-46f4-bc9b-d4fea707df74)\"" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr" podUID="823999b1-3441-46f4-bc9b-d4fea707df74"
Jul 02 23:11:59.152585 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.152550    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:59.155236 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.155212    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19854b9a-bf87-470b-8247-726cf8e416a9-metrics-tls\") pod \"dns-default-25fl5\" (UID: \"19854b9a-bf87-470b-8247-726cf8e416a9\") " pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:59.329881 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.329836    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-stw2z" event={"ID":"b67810dc-1b52-4571-8430-9e1eb815d6e8","Type":"ContainerStarted","Data":"4f7e2d32c02dce85433593422f4b3ed7362060c5d99911744feaa4b675ebc70d"}
Jul 02 23:11:59.331979 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.331943    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmn8c" event={"ID":"c68d2447-a88a-40ba-a9a3-82a40ef83b8f","Type":"ContainerStarted","Data":"3e20f09fdfb6a3a6f4bc1b77e4ca85957025c391269aad9be4362163e38d5db6"}
Jul 02 23:11:59.333729 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.333700    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-46nf6" event={"ID":"82141c32-ce33-4ece-b8af-7a5d455883a6","Type":"ContainerStarted","Data":"ddada0f44337c7a1a4b185a1ef1c5d3558f1617c1ebeb54312f2f1c8ba1ac7c5"}
Jul 02 23:11:59.333834 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.333746    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-46nf6" event={"ID":"82141c32-ce33-4ece-b8af-7a5d455883a6","Type":"ContainerStarted","Data":"9ffa1655b1fda4d07e4cc2c12edfe451223a275fbddede11a900bf30694f028f"}
Jul 02 23:11:59.333886 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.333849    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:11:59.357117 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.354672    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-46nf6" podStartSLOduration=66.354653179 podStartE2EDuration="1m6.354653179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:59.351148837 +0000 UTC m=+67.975567218" watchObservedRunningTime="2026-07-02 23:11:59.354653179 +0000 UTC m=+67.979071557"
Jul 02 23:11:59.375559 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.375530    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2clb5\""
Jul 02 23:11:59.383231 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.383208    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-25fl5"
Jul 02 23:11:59.723744 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.723714    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-25fl5"]
Jul 02 23:11:59.727038 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:11:59.727011    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19854b9a_bf87_470b_8247_726cf8e416a9.slice/crio-f9c24771a07577383e56a214427e21d1058690cf73ea68e39bc6fa8af4dc3e10 WatchSource:0}: Error finding container f9c24771a07577383e56a214427e21d1058690cf73ea68e39bc6fa8af4dc3e10: Status 404 returned error can't find the container with id f9c24771a07577383e56a214427e21d1058690cf73ea68e39bc6fa8af4dc3e10
Jul 02 23:11:59.860046 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.859967    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppkff\" (UID: \"8fe31884-e666-46fd-a2c2-d99a9bd43fa7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"
Jul 02 23:11:59.860046 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.860019    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:59.860275 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.860064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:59.862888 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.862862    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44bb06c8-7187-4452-9d34-7d8094f61e3c-metrics-certs\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:59.863039 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.862994    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fe31884-e666-46fd-a2c2-d99a9bd43fa7-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppkff\" (UID: \"8fe31884-e666-46fd-a2c2-d99a9bd43fa7\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"
Jul 02 23:11:59.863039 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.862981    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bd26f6f0-1585-45d3-8b38-c8fed2255d7e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-7tlln\" (UID: \"bd26f6f0-1585-45d3-8b38-c8fed2255d7e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:59.924729 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.924695    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-krsfl\""
Jul 02 23:11:59.931873 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.931850    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"
Jul 02 23:11:59.942564 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.942539    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-75ddl\""
Jul 02 23:11:59.949871 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.949847    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"
Jul 02 23:11:59.960995 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.960462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:11:59.960995 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.960536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:59.961251 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.961200    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44bb06c8-7187-4452-9d34-7d8094f61e3c-service-ca-bundle\") pod \"router-default-6bf5644d8f-z2hn2\" (UID: \"44bb06c8-7187-4452-9d34-7d8094f61e3c\") " pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:11:59.963758 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:11:59.963715    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls\") pod \"image-registry-86677c8bd8-rsngf\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") " pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:12:00.137984 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.137898    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff"]
Jul 02 23:12:00.186221 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.186114    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln"]
Jul 02 23:12:00.189430 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:12:00.189401    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd26f6f0_1585_45d3_8b38_c8fed2255d7e.slice/crio-8af592ee03b4e969800125b1f27ddb41fc21ca78e2a598ee8251acfc356381d3 WatchSource:0}: Error finding container 8af592ee03b4e969800125b1f27ddb41fc21ca78e2a598ee8251acfc356381d3: Status 404 returned error can't find the container with id 8af592ee03b4e969800125b1f27ddb41fc21ca78e2a598ee8251acfc356381d3
Jul 02 23:12:00.218233 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.218205    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kcbnf\""
Jul 02 23:12:00.225631 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.225444    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:12:00.233846 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.233656    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ljjlr\""
Jul 02 23:12:00.241712 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.241610    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:12:00.343883 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.343816    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln" event={"ID":"bd26f6f0-1585-45d3-8b38-c8fed2255d7e","Type":"ContainerStarted","Data":"8af592ee03b4e969800125b1f27ddb41fc21ca78e2a598ee8251acfc356381d3"}
Jul 02 23:12:00.350683 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.349837    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-stw2z" event={"ID":"b67810dc-1b52-4571-8430-9e1eb815d6e8","Type":"ContainerStarted","Data":"5803899eaf1cbe4e003d580d185f1964dfadfe8b77cef6c6d604a03765ebc0fe"}
Jul 02 23:12:00.350683 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.349896    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-stw2z" event={"ID":"b67810dc-1b52-4571-8430-9e1eb815d6e8","Type":"ContainerStarted","Data":"1f5189d8dfc72265368ba13a3cceb3faaaf96f9896d944021e31827cc2d99372"}
Jul 02 23:12:00.352406 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.352331    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff" event={"ID":"8fe31884-e666-46fd-a2c2-d99a9bd43fa7","Type":"ContainerStarted","Data":"939684d6a034af077712fe6df00be7e83f6dd4497956bc98c31a9115c61f7a9a"}
Jul 02 23:12:00.354943 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.354830    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-25fl5" event={"ID":"19854b9a-bf87-470b-8247-726cf8e416a9","Type":"ContainerStarted","Data":"f9c24771a07577383e56a214427e21d1058690cf73ea68e39bc6fa8af4dc3e10"}
Jul 02 23:12:00.369305 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.368133    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-stw2z" podStartSLOduration=66.931445508 podStartE2EDuration="1m8.368114257s" totalImagesPullingTime="1.436668749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:00.367444429 +0000 UTC m=+68.991862806" watchObservedRunningTime="2026-07-02 23:12:00.368114257 +0000 UTC m=+68.992532634"
Jul 02 23:12:00.424674 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.424409    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86677c8bd8-rsngf"]
Jul 02 23:12:00.427501 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:12:00.427469    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16baa0f_554a_469b_a393_d447c0bae9f2.slice/crio-0d490cea437fcb706eae2a0df1809d1ded0603022b55c79215855df32dded0c5 WatchSource:0}: Error finding container 0d490cea437fcb706eae2a0df1809d1ded0603022b55c79215855df32dded0c5: Status 404 returned error can't find the container with id 0d490cea437fcb706eae2a0df1809d1ded0603022b55c79215855df32dded0c5
Jul 02 23:12:00.442386 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.442305    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bf5644d8f-z2hn2"]
Jul 02 23:12:00.446101 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:12:00.446067    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44bb06c8_7187_4452_9d34_7d8094f61e3c.slice/crio-8f4297357f42ad8bf774aa88126545986ab9f63c121f65e2c79aa4e7506a0755 WatchSource:0}: Error finding container 8f4297357f42ad8bf774aa88126545986ab9f63c121f65e2c79aa4e7506a0755: Status 404 returned error can't find the container with id 8f4297357f42ad8bf774aa88126545986ab9f63c121f65e2c79aa4e7506a0755
Jul 02 23:12:00.766662 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.766472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-67phh\" (UID: \"10b07ca3-e57c-4169-998a-2351dc0dcf1d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh"
Jul 02 23:12:00.770320 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.770263    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/10b07ca3-e57c-4169-998a-2351dc0dcf1d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-67phh\" (UID: \"10b07ca3-e57c-4169-998a-2351dc0dcf1d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh"
Jul 02 23:12:00.980390 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.980354    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lzhrg\""
Jul 02 23:12:00.987312 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:00.987280    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh"
Jul 02 23:12:01.200534 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:01.200450    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-67phh"]
Jul 02 23:12:01.365977 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:01.365237    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bf5644d8f-z2hn2" event={"ID":"44bb06c8-7187-4452-9d34-7d8094f61e3c","Type":"ContainerStarted","Data":"cb246677f59761bf263646dd240b180050066406171fab5ea9aabff89b43fc0c"}
Jul 02 23:12:01.365977 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:01.365300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bf5644d8f-z2hn2" event={"ID":"44bb06c8-7187-4452-9d34-7d8094f61e3c","Type":"ContainerStarted","Data":"8f4297357f42ad8bf774aa88126545986ab9f63c121f65e2c79aa4e7506a0755"}
Jul 02 23:12:01.369116 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:01.369006    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86677c8bd8-rsngf" event={"ID":"a16baa0f-554a-469b-a393-d447c0bae9f2","Type":"ContainerStarted","Data":"47241245bb1dfcf5078e9c3034b048cc29f0bf28dd9a4d3350ca8d8891b372ec"}
Jul 02 23:12:01.369116 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:01.369051    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:12:01.369116 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:01.369070    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86677c8bd8-rsngf" event={"ID":"a16baa0f-554a-469b-a393-d447c0bae9f2","Type":"ContainerStarted","Data":"0d490cea437fcb706eae2a0df1809d1ded0603022b55c79215855df32dded0c5"}
Jul 02 23:12:01.413708 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:01.413098    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86677c8bd8-rsngf" podStartSLOduration=68.413076858 podStartE2EDuration="1m8.413076858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:01.412948741 +0000 UTC m=+70.037367117" watchObservedRunningTime="2026-07-02 23:12:01.413076858 +0000 UTC m=+70.037495232"
Jul 02 23:12:01.413708 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:01.413615    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6bf5644d8f-z2hn2" podStartSLOduration=36.413602576 podStartE2EDuration="36.413602576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:01.392410574 +0000 UTC m=+70.016828950" watchObservedRunningTime="2026-07-02 23:12:01.413602576 +0000 UTC m=+70.038020933"
Jul 02 23:12:02.024275 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.024244    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"]
Jul 02 23:12:02.026664 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.026640    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"
Jul 02 23:12:02.031905 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.031883    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 23:12:02.032048 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.031898    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 23:12:02.032048 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.031951    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 23:12:02.033449 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.033372    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 02 23:12:02.073446 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.073411    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"]
Jul 02 23:12:02.177520 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.177412    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/12815974-63eb-4602-b5d0-9570ad7b2a2e-klusterlet-config\") pod \"klusterlet-addon-workmgr-54b8ff567-hx7x7\" (UID: \"12815974-63eb-4602-b5d0-9570ad7b2a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"
Jul 02 23:12:02.177520 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.177497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12815974-63eb-4602-b5d0-9570ad7b2a2e-tmp\") pod \"klusterlet-addon-workmgr-54b8ff567-hx7x7\" (UID: \"12815974-63eb-4602-b5d0-9570ad7b2a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"
Jul 02 23:12:02.177801 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.177532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v5dc\" (UniqueName: \"kubernetes.io/projected/12815974-63eb-4602-b5d0-9570ad7b2a2e-kube-api-access-7v5dc\") pod \"klusterlet-addon-workmgr-54b8ff567-hx7x7\" (UID: \"12815974-63eb-4602-b5d0-9570ad7b2a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"
Jul 02 23:12:02.242394 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.242325    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:12:02.245340 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.245316    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:12:02.278583 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.278493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/12815974-63eb-4602-b5d0-9570ad7b2a2e-klusterlet-config\") pod \"klusterlet-addon-workmgr-54b8ff567-hx7x7\" (UID: \"12815974-63eb-4602-b5d0-9570ad7b2a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"
Jul 02 23:12:02.278583 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.278571    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12815974-63eb-4602-b5d0-9570ad7b2a2e-tmp\") pod \"klusterlet-addon-workmgr-54b8ff567-hx7x7\" (UID: \"12815974-63eb-4602-b5d0-9570ad7b2a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"
Jul 02 23:12:02.278818 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.278596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v5dc\" (UniqueName: \"kubernetes.io/projected/12815974-63eb-4602-b5d0-9570ad7b2a2e-kube-api-access-7v5dc\") pod \"klusterlet-addon-workmgr-54b8ff567-hx7x7\" (UID: \"12815974-63eb-4602-b5d0-9570ad7b2a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"
Jul 02 23:12:02.279157 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.279122    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12815974-63eb-4602-b5d0-9570ad7b2a2e-tmp\") pod \"klusterlet-addon-workmgr-54b8ff567-hx7x7\" (UID: \"12815974-63eb-4602-b5d0-9570ad7b2a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"
Jul 02 23:12:02.281712 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.281684    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/12815974-63eb-4602-b5d0-9570ad7b2a2e-klusterlet-config\") pod \"klusterlet-addon-workmgr-54b8ff567-hx7x7\" (UID: \"12815974-63eb-4602-b5d0-9570ad7b2a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"
Jul 02 23:12:02.305259 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.305227    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v5dc\" (UniqueName: \"kubernetes.io/projected/12815974-63eb-4602-b5d0-9570ad7b2a2e-kube-api-access-7v5dc\") pod \"klusterlet-addon-workmgr-54b8ff567-hx7x7\" (UID: \"12815974-63eb-4602-b5d0-9570ad7b2a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"
Jul 02 23:12:02.338952 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.338903    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"
Jul 02 23:12:02.372861 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.372807    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:12:02.374130 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:02.374111    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6bf5644d8f-z2hn2"
Jul 02 23:12:02.834891 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:12:02.834852    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b07ca3_e57c_4169_998a_2351dc0dcf1d.slice/crio-af6a70207995cdefde8d3f303e4762caf2eda6d0eacca123e4097e4247318dce WatchSource:0}: Error finding container af6a70207995cdefde8d3f303e4762caf2eda6d0eacca123e4097e4247318dce: Status 404 returned error can't find the container with id af6a70207995cdefde8d3f303e4762caf2eda6d0eacca123e4097e4247318dce
Jul 02 23:12:03.377989 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:03.377899    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh" event={"ID":"10b07ca3-e57c-4169-998a-2351dc0dcf1d","Type":"ContainerStarted","Data":"af6a70207995cdefde8d3f303e4762caf2eda6d0eacca123e4097e4247318dce"}
Jul 02 23:12:05.546824 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:05.546800    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"]
Jul 02 23:12:05.721747 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:12:05.721713    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12815974_63eb_4602_b5d0_9570ad7b2a2e.slice/crio-6d0b97fe0615bc7c278d3921f4f29a99c8a07c6f457683eeede2a7bcafe62fc4 WatchSource:0}: Error finding container 6d0b97fe0615bc7c278d3921f4f29a99c8a07c6f457683eeede2a7bcafe62fc4: Status 404 returned error can't find the container with id 6d0b97fe0615bc7c278d3921f4f29a99c8a07c6f457683eeede2a7bcafe62fc4
Jul 02 23:12:06.291599 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.291567    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2k2pj"]
Jul 02 23:12:06.295545 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.295527    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2k2pj"
Jul 02 23:12:06.298600 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.298568    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 02 23:12:06.298729 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.298649    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-x5j5x\""
Jul 02 23:12:06.303751 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.303730    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2k2pj"]
Jul 02 23:12:06.305489 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.305470    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/03497354-a870-46b5-987a-b70aa5245dfb-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-2k2pj\" (UID: \"03497354-a870-46b5-987a-b70aa5245dfb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2k2pj"
Jul 02 23:12:06.392346 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.392308    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fjtpp" event={"ID":"904dd94e-b420-4d10-a889-3dd86aecf071","Type":"ContainerStarted","Data":"aa96f53fc91b6574851d73f5bb770d7d22d83c8c45f1a128a21febaac1515696"}
Jul 02 23:12:06.394077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.394048    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff" event={"ID":"8fe31884-e666-46fd-a2c2-d99a9bd43fa7","Type":"ContainerStarted","Data":"2b01f26ce9ee9c5cdcd84cb18539aeee6ecfc8f90bfabae6ffd72a7a4f7e413e"}
Jul 02 23:12:06.394207 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.394104    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff" event={"ID":"8fe31884-e666-46fd-a2c2-d99a9bd43fa7","Type":"ContainerStarted","Data":"67ebaf7ff37f8768e31edddd5462130d263a28c5d14dd2658627b1d88bc9bf3c"}
Jul 02 23:12:06.395701 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.395682    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-25fl5" event={"ID":"19854b9a-bf87-470b-8247-726cf8e416a9","Type":"ContainerStarted","Data":"87092bc40dbce6eb9bc2a7a344c350de5bbb31ab22731c795529363e816bf66b"}
Jul 02 23:12:06.395810 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.395718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-25fl5" event={"ID":"19854b9a-bf87-470b-8247-726cf8e416a9","Type":"ContainerStarted","Data":"a6e951459c5185ce7ddd91356093433e7988473dd4022af56ee83550806e7f2b"}
Jul 02 23:12:06.395810 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.395742    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-25fl5"
Jul 02 23:12:06.398035 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.398014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmn8c" event={"ID":"c68d2447-a88a-40ba-a9a3-82a40ef83b8f","Type":"ContainerStarted","Data":"6d9c3c60d24e3beaa9b8d68278e24cc169a63db62c411ddffdbfd7a2f311670d"}
Jul 02 23:12:06.399412 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.399390    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln" event={"ID":"bd26f6f0-1585-45d3-8b38-c8fed2255d7e","Type":"ContainerStarted","Data":"4da16bb3fcf509dd450d6bea947e202d2e987472e19e0652b3f9f9b3c15a4caa"}
Jul 02 23:12:06.400465 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.400439    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7" event={"ID":"12815974-63eb-4602-b5d0-9570ad7b2a2e","Type":"ContainerStarted","Data":"6d0b97fe0615bc7c278d3921f4f29a99c8a07c6f457683eeede2a7bcafe62fc4"}
Jul 02 23:12:06.401629 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.401611    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh" event={"ID":"10b07ca3-e57c-4169-998a-2351dc0dcf1d","Type":"ContainerStarted","Data":"a5a9b0d73305ca952a0af485b199459f93b49da2da9891bf911f757da3abd87e"}
Jul 02 23:12:06.406421 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.406401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/03497354-a870-46b5-987a-b70aa5245dfb-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-2k2pj\" (UID: \"03497354-a870-46b5-987a-b70aa5245dfb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2k2pj"
Jul 02 23:12:06.406552 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:12:06.406533    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 02 23:12:06.406619 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:12:06.406604    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03497354-a870-46b5-987a-b70aa5245dfb-tls-certificates podName:03497354-a870-46b5-987a-b70aa5245dfb nodeName:}" failed. No retries permitted until 2026-07-02 23:12:06.906582775 +0000 UTC m=+75.531001146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/03497354-a870-46b5-987a-b70aa5245dfb-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-2k2pj" (UID: "03497354-a870-46b5-987a-b70aa5245dfb") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 02 23:12:06.410123 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.410086    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fjtpp" podStartSLOduration=66.260727969 podStartE2EDuration="1m13.410073478s" totalImagesPullingTime="7.149345509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:06.408808287 +0000 UTC m=+75.033226665" watchObservedRunningTime="2026-07-02 23:12:06.410073478 +0000 UTC m=+75.034491853"
Jul 02 23:12:06.427486 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.427442    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-25fl5" podStartSLOduration=33.941037998 podStartE2EDuration="39.427428411s" totalImagesPullingTime="5.486390413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:06.426735862 +0000 UTC m=+75.051154239" watchObservedRunningTime="2026-07-02 23:12:06.427428411 +0000 UTC m=+75.051846816"
Jul 02 23:12:06.445342 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.445297    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nmn8c" podStartSLOduration=17.441569982 podStartE2EDuration="28.445283994s" totalImagesPullingTime="11.003714012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:06.444581181 +0000 UTC m=+75.068999551" watchObservedRunningTime="2026-07-02 23:12:06.445283994 +0000 UTC m=+75.069702370"
Jul 02 23:12:06.464387 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.464339    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppkff" podStartSLOduration=35.970982661 podStartE2EDuration="41.464324719s" totalImagesPullingTime="5.493342058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:06.463579066 +0000 UTC m=+75.087997443" watchObservedRunningTime="2026-07-02 23:12:06.464324719 +0000 UTC m=+75.088743154"
Jul 02 23:12:06.482311 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.482265    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-7tlln" podStartSLOduration=35.26119654 podStartE2EDuration="40.482253117s" totalImagesPullingTime="5.221056577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:06.481415091 +0000 UTC m=+75.105833470" watchObservedRunningTime="2026-07-02 23:12:06.482253117 +0000 UTC m=+75.106671493"
Jul 02 23:12:06.498590 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.498542    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-67phh" podStartSLOduration=35.550904697 podStartE2EDuration="38.498527934s" totalImagesPullingTime="2.947623237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:06.498075217 +0000 UTC m=+75.122493594" watchObservedRunningTime="2026-07-02 23:12:06.498527934 +0000 UTC m=+75.122946310"
Jul 02 23:12:06.910194 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.910156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/03497354-a870-46b5-987a-b70aa5245dfb-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-2k2pj\" (UID: \"03497354-a870-46b5-987a-b70aa5245dfb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2k2pj"
Jul 02 23:12:06.912530 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:06.912509    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/03497354-a870-46b5-987a-b70aa5245dfb-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-2k2pj\" (UID: \"03497354-a870-46b5-987a-b70aa5245dfb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2k2pj"
Jul 02 23:12:07.206158 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:07.206077    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2k2pj"
Jul 02 23:12:07.355706 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:07.355560    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2k2pj"]
Jul 02 23:12:07.358290 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:12:07.358264    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03497354_a870_46b5_987a_b70aa5245dfb.slice/crio-c1f4dbaebff60bbe0e97f18c8f64c9411bbef2c6bce1206fd797eb6acf5fa01f WatchSource:0}: Error finding container c1f4dbaebff60bbe0e97f18c8f64c9411bbef2c6bce1206fd797eb6acf5fa01f: Status 404 returned error can't find the container with id c1f4dbaebff60bbe0e97f18c8f64c9411bbef2c6bce1206fd797eb6acf5fa01f
Jul 02 23:12:07.406613 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:07.406573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2k2pj" event={"ID":"03497354-a870-46b5-987a-b70aa5245dfb","Type":"ContainerStarted","Data":"c1f4dbaebff60bbe0e97f18c8f64c9411bbef2c6bce1206fd797eb6acf5fa01f"}
Jul 02 23:12:10.879990 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:10.879960    2563 scope.go:117] "RemoveContainer" containerID="ae7e4270b55ec2e198554ffffdcf5d923bf94b6a4a5f31460b9cabe039ee31ae"
Jul 02 23:12:10.880433 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:12:10.880150    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-8jdxr_openshift-console-operator(823999b1-3441-46f4-bc9b-d4fea707df74)\"" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr" podUID="823999b1-3441-46f4-bc9b-d4fea707df74"
Jul 02 23:12:11.426357 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:11.426319    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2k2pj" event={"ID":"03497354-a870-46b5-987a-b70aa5245dfb","Type":"ContainerStarted","Data":"774ce60ebad3f057047685d15e51b76006f786995d6d5fafcb2ae5121cca10dc"}
Jul 02 23:12:11.426559 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:11.426534    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2k2pj"
Jul 02 23:12:11.431131 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:11.431108    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2k2pj"
Jul 02 23:12:11.443880 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:11.443833    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2k2pj" podStartSLOduration=1.793173455 podStartE2EDuration="5.443821032s" totalImagesPullingTime="3.650647577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:11.44240291 +0000 UTC m=+80.066821288" watchObservedRunningTime="2026-07-02 23:12:11.443821032 +0000 UTC m=+80.068239408"
Jul 02 23:12:12.431421 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:12.431383    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7" event={"ID":"12815974-63eb-4602-b5d0-9570ad7b2a2e","Type":"ContainerStarted","Data":"e935da46108a4dcaf34946aae11cc636cff1adfa8f3ecb4240beccb8c423b0a3"}
Jul 02 23:12:12.448830 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:12.448780    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7" podStartSLOduration=5.728594242 podStartE2EDuration="11.448765784s" totalImagesPullingTime="5.720171542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:12.447175809 +0000 UTC m=+81.071594185" watchObservedRunningTime="2026-07-02 23:12:12.448765784 +0000 UTC m=+81.073184163"
Jul 02 23:12:13.435373 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:13.435345    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"
Jul 02 23:12:13.436753 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:13.436725    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54b8ff567-hx7x7"
Jul 02 23:12:16.410001 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:16.409861    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-25fl5"
Jul 02 23:12:18.716642 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.716610    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2njzq"]
Jul 02 23:12:18.720877 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.720856    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.723888 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.723862    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 23:12:18.724012 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.723941    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wq2d5\""
Jul 02 23:12:18.725255 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.725237    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 23:12:18.725338 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.725260    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 23:12:18.725338 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.725271    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 23:12:18.802770 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.802737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a19d3b9-5884-4368-a62d-de415fc84adf-sys\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.802770 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.802770    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a19d3b9-5884-4368-a62d-de415fc84adf-root\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.802977 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.802797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a19d3b9-5884-4368-a62d-de415fc84adf-node-exporter-wtmp\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.802977 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.802824    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a19d3b9-5884-4368-a62d-de415fc84adf-metrics-client-ca\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.802977 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.802853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a19d3b9-5884-4368-a62d-de415fc84adf-node-exporter-textfile\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.802977 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.802870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6qn2\" (UniqueName: \"kubernetes.io/projected/9a19d3b9-5884-4368-a62d-de415fc84adf-kube-api-access-j6qn2\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.802977 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.802892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a19d3b9-5884-4368-a62d-de415fc84adf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.802977 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.802970    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a19d3b9-5884-4368-a62d-de415fc84adf-node-exporter-accelerators-collector-config\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.803160 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.802999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a19d3b9-5884-4368-a62d-de415fc84adf-node-exporter-tls\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.903829 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.903798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a19d3b9-5884-4368-a62d-de415fc84adf-node-exporter-textfile\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.903829 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.903828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6qn2\" (UniqueName: \"kubernetes.io/projected/9a19d3b9-5884-4368-a62d-de415fc84adf-kube-api-access-j6qn2\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.904083 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.903851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a19d3b9-5884-4368-a62d-de415fc84adf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.904083 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.903881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a19d3b9-5884-4368-a62d-de415fc84adf-node-exporter-accelerators-collector-config\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.904083 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.903911    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a19d3b9-5884-4368-a62d-de415fc84adf-node-exporter-tls\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.904083 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.903976    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a19d3b9-5884-4368-a62d-de415fc84adf-sys\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.904083 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.903999    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a19d3b9-5884-4368-a62d-de415fc84adf-root\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.904083 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.904032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a19d3b9-5884-4368-a62d-de415fc84adf-node-exporter-wtmp\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.904083 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.904056    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a19d3b9-5884-4368-a62d-de415fc84adf-metrics-client-ca\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.904424 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.904164    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9a19d3b9-5884-4368-a62d-de415fc84adf-node-exporter-textfile\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.904424 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.904188    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9a19d3b9-5884-4368-a62d-de415fc84adf-root\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.904424 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.904193    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a19d3b9-5884-4368-a62d-de415fc84adf-sys\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.904424 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.904287    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9a19d3b9-5884-4368-a62d-de415fc84adf-node-exporter-wtmp\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.904617 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.904559    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9a19d3b9-5884-4368-a62d-de415fc84adf-node-exporter-accelerators-collector-config\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.904617 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.904582    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a19d3b9-5884-4368-a62d-de415fc84adf-metrics-client-ca\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.906296 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.906276    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a19d3b9-5884-4368-a62d-de415fc84adf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.906401 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.906366    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9a19d3b9-5884-4368-a62d-de415fc84adf-node-exporter-tls\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:18.916858 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:18.916833    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6qn2\" (UniqueName: \"kubernetes.io/projected/9a19d3b9-5884-4368-a62d-de415fc84adf-kube-api-access-j6qn2\") pod \"node-exporter-2njzq\" (UID: \"9a19d3b9-5884-4368-a62d-de415fc84adf\") " pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:19.029384 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:19.029305    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2njzq"
Jul 02 23:12:19.040966 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:12:19.040933    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a19d3b9_5884_4368_a62d_de415fc84adf.slice/crio-ba59500a4fee01dec5714b573807457ff4443a8181e63be4a695a775542d93bb WatchSource:0}: Error finding container ba59500a4fee01dec5714b573807457ff4443a8181e63be4a695a775542d93bb: Status 404 returned error can't find the container with id ba59500a4fee01dec5714b573807457ff4443a8181e63be4a695a775542d93bb
Jul 02 23:12:19.459000 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:19.458954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2njzq" event={"ID":"9a19d3b9-5884-4368-a62d-de415fc84adf","Type":"ContainerStarted","Data":"ba59500a4fee01dec5714b573807457ff4443a8181e63be4a695a775542d93bb"}
Jul 02 23:12:20.230655 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:20.230570    2563 patch_prober.go:28] interesting pod/image-registry-86677c8bd8-rsngf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 23:12:20.230655 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:20.230620    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86677c8bd8-rsngf" podUID="a16baa0f-554a-469b-a393-d447c0bae9f2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 23:12:20.465352 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:20.465314    2563 generic.go:356] "Generic (PLEG): container finished" podID="9a19d3b9-5884-4368-a62d-de415fc84adf" containerID="b07c5f7fa91dcb21cebf2d5869a2dd844f9a8237a56189851ddb6fc1edaf036b" exitCode=0
Jul 02 23:12:20.465515 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:20.465371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2njzq" event={"ID":"9a19d3b9-5884-4368-a62d-de415fc84adf","Type":"ContainerDied","Data":"b07c5f7fa91dcb21cebf2d5869a2dd844f9a8237a56189851ddb6fc1edaf036b"}
Jul 02 23:12:21.471509 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:21.471479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2njzq" event={"ID":"9a19d3b9-5884-4368-a62d-de415fc84adf","Type":"ContainerStarted","Data":"775fb646bd5b69431e6251f4ca3f91d853ffe6eee94575c86abb7114170ca90b"}
Jul 02 23:12:21.471852 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:21.471529    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2njzq" event={"ID":"9a19d3b9-5884-4368-a62d-de415fc84adf","Type":"ContainerStarted","Data":"69ff1031b08e05520a7beb287ac8471163ebb0aa4469515fe41f966b8498b756"}
Jul 02 23:12:22.376979 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:22.376953    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:12:22.402677 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:22.402629    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2njzq" podStartSLOduration=3.478950144 podStartE2EDuration="4.402614209s" totalImagesPullingTime="861.815376ms" totalInitContainerRuntime="61.848689ms" isStatefulPod=true podCreationTimestamp="2026-07-02 23:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:21.526150662 +0000 UTC m=+90.150569055" watchObservedRunningTime="2026-07-02 23:12:22.402614209 +0000 UTC m=+91.027032584"
Jul 02 23:12:24.880559 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:24.880528    2563 scope.go:117] "RemoveContainer" containerID="ae7e4270b55ec2e198554ffffdcf5d923bf94b6a4a5f31460b9cabe039ee31ae"
Jul 02 23:12:25.489581 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:25.489557    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:12:25.489743 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:25.489656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr" event={"ID":"823999b1-3441-46f4-bc9b-d4fea707df74","Type":"ContainerStarted","Data":"6d0a26dbee242fa5be702398e17a42054642c1dc3e6ea688da4fe87a323e079a"}
Jul 02 23:12:25.489969 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:25.489945    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:12:25.508017 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:25.507969    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr" podStartSLOduration=53.310081399 podStartE2EDuration="1m0.507954704s" totalImagesPullingTime="7.197873305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:25.507343696 +0000 UTC m=+94.131762074" watchObservedRunningTime="2026-07-02 23:12:25.507954704 +0000 UTC m=+94.132373080"
Jul 02 23:12:25.524845 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:25.524819    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-8jdxr"
Jul 02 23:12:25.689117 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:25.689081    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86677c8bd8-rsngf"]
Jul 02 23:12:25.703237 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:25.703209    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-hn444"]
Jul 02 23:12:25.706563 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:25.706540    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-hn444"
Jul 02 23:12:25.711067 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:25.711043    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 23:12:25.711196 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:25.711043    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-p9kjk\""
Jul 02 23:12:25.711196 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:25.711132    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 23:12:25.732264 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:25.732225    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-hn444"]
Jul 02 23:12:25.760865 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:25.760789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkbq4\" (UniqueName: \"kubernetes.io/projected/8a361e93-6142-4060-9b70-a94e8f54ec24-kube-api-access-vkbq4\") pod \"downloads-685bfb5f64-hn444\" (UID: \"8a361e93-6142-4060-9b70-a94e8f54ec24\") " pod="openshift-console/downloads-685bfb5f64-hn444"
Jul 02 23:12:25.861418 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:25.861378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbq4\" (UniqueName: \"kubernetes.io/projected/8a361e93-6142-4060-9b70-a94e8f54ec24-kube-api-access-vkbq4\") pod \"downloads-685bfb5f64-hn444\" (UID: \"8a361e93-6142-4060-9b70-a94e8f54ec24\") " pod="openshift-console/downloads-685bfb5f64-hn444"
Jul 02 23:12:25.871164 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:25.871141    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkbq4\" (UniqueName: \"kubernetes.io/projected/8a361e93-6142-4060-9b70-a94e8f54ec24-kube-api-access-vkbq4\") pod \"downloads-685bfb5f64-hn444\" (UID: \"8a361e93-6142-4060-9b70-a94e8f54ec24\") " pod="openshift-console/downloads-685bfb5f64-hn444"
Jul 02 23:12:26.017282 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:26.017202    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-hn444"
Jul 02 23:12:26.149315 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:26.149285    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-hn444"]
Jul 02 23:12:26.152468 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:12:26.152440    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a361e93_6142_4060_9b70_a94e8f54ec24.slice/crio-426fe7f83c2b19867e41dc7cf5bfdc5c9142717ce3eac585c03403b2abb1410e WatchSource:0}: Error finding container 426fe7f83c2b19867e41dc7cf5bfdc5c9142717ce3eac585c03403b2abb1410e: Status 404 returned error can't find the container with id 426fe7f83c2b19867e41dc7cf5bfdc5c9142717ce3eac585c03403b2abb1410e
Jul 02 23:12:26.494770 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:26.494736    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-hn444" event={"ID":"8a361e93-6142-4060-9b70-a94e8f54ec24","Type":"ContainerStarted","Data":"426fe7f83c2b19867e41dc7cf5bfdc5c9142717ce3eac585c03403b2abb1410e"}
Jul 02 23:12:30.357390 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:30.357356    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-46nf6"
Jul 02 23:12:36.210063 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.210030    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d99c78947-xg22c"]
Jul 02 23:12:36.246059 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.246020    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d99c78947-xg22c"]
Jul 02 23:12:36.246285 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.246150    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.249362 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.249338    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 23:12:36.249362 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.249350    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 23:12:36.249362 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.249339    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 23:12:36.250624 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.250602    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 23:12:36.250717 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.250601    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rfnb2\""
Jul 02 23:12:36.250717 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.250609    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 23:12:36.344144 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.344074    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-serving-cert\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.344144 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.344117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-oauth-config\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.344386 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.344205    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mv8g\" (UniqueName: \"kubernetes.io/projected/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-kube-api-access-6mv8g\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.344386 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.344323    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-config\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.344386 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.344375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-oauth-serving-cert\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.344523 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.344424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-service-ca\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.445356 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.445315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mv8g\" (UniqueName: \"kubernetes.io/projected/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-kube-api-access-6mv8g\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.445540 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.445396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-config\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.445540 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.445415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-oauth-serving-cert\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.445540 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.445439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-service-ca\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.445540 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.445468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-serving-cert\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.445540 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.445491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-oauth-config\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.446312 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.446258    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-config\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.446312 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.446277    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-oauth-serving-cert\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.446503 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.446428    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-service-ca\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.448363 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.448341    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-oauth-config\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.448466 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.448364    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-serving-cert\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.455183 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.455159    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mv8g\" (UniqueName: \"kubernetes.io/projected/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-kube-api-access-6mv8g\") pod \"console-7d99c78947-xg22c\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") " pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:36.557720 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:36.557632    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:42.597002 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:42.596963    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d99c78947-xg22c"]
Jul 02 23:12:42.601292 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:12:42.601265    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ff64b4_be9a_426f_8577_8f2f71d0a1a1.slice/crio-8395944e0051c22219a267e66804e41dad58ee105b87d6d81948643c5654c7e7 WatchSource:0}: Error finding container 8395944e0051c22219a267e66804e41dad58ee105b87d6d81948643c5654c7e7: Status 404 returned error can't find the container with id 8395944e0051c22219a267e66804e41dad58ee105b87d6d81948643c5654c7e7
Jul 02 23:12:43.569935 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.569769    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d99c78947-xg22c" event={"ID":"83ff64b4-be9a-426f-8577-8f2f71d0a1a1","Type":"ContainerStarted","Data":"8395944e0051c22219a267e66804e41dad58ee105b87d6d81948643c5654c7e7"}
Jul 02 23:12:43.571844 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.571812    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-hn444" event={"ID":"8a361e93-6142-4060-9b70-a94e8f54ec24","Type":"ContainerStarted","Data":"958d5068250e42742135769e8351351f51d2672d6933ebe5c1a45fb866545a1c"}
Jul 02 23:12:43.572111 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.572088    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-hn444"
Jul 02 23:12:43.586042 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.585996    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-hn444"
Jul 02 23:12:43.622315 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.622250    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-hn444" podStartSLOduration=2.123767564 podStartE2EDuration="18.622229703s" totalImagesPullingTime="16.498462139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:43.59413521 +0000 UTC m=+112.218553601" watchObservedRunningTime="2026-07-02 23:12:43.622229703 +0000 UTC m=+112.246648079"
Jul 02 23:12:43.810927 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.810876    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-855df44cff-vfm62"]
Jul 02 23:12:43.833500 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.833463    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-855df44cff-vfm62"]
Jul 02 23:12:43.833686 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.833593    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:43.841684 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.841606    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 02 23:12:43.916806 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.916760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmctm\" (UniqueName: \"kubernetes.io/projected/39a404e4-fcd5-4754-9b8c-f8a426960e4b-kube-api-access-jmctm\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:43.917014 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.916827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-oauth-serving-cert\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:43.917014 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.916851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-service-ca\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:43.917014 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.916888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-oauth-config\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:43.917014 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.916937    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-serving-cert\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:43.917246 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.917042    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-config\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:43.917246 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:43.917128    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-trusted-ca-bundle\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.018312 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.018272    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-oauth-serving-cert\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.018525 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.018326    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-service-ca\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.018525 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.018385    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-oauth-config\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.018525 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.018414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-serving-cert\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.018525 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.018448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-config\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.018525 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.018475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-trusted-ca-bundle\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.018789 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.018565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmctm\" (UniqueName: \"kubernetes.io/projected/39a404e4-fcd5-4754-9b8c-f8a426960e4b-kube-api-access-jmctm\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.019984 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.019497    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-oauth-serving-cert\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.020320 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.020262    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-service-ca\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.021698 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.021668    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-trusted-ca-bundle\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.022137 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.022092    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-config\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.023373 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.023327    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-serving-cert\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.024365 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.024343    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-oauth-config\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.030652 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.030626    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmctm\" (UniqueName: \"kubernetes.io/projected/39a404e4-fcd5-4754-9b8c-f8a426960e4b-kube-api-access-jmctm\") pod \"console-855df44cff-vfm62\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") " pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.146755 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.146490    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:44.365193 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.365112    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-855df44cff-vfm62"]
Jul 02 23:12:44.369171 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:12:44.369134    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a404e4_fcd5_4754_9b8c_f8a426960e4b.slice/crio-e77b0218d0c89e91beb0bc05842c10f173353f37c7a5644a9531aa23b76b7f50 WatchSource:0}: Error finding container e77b0218d0c89e91beb0bc05842c10f173353f37c7a5644a9531aa23b76b7f50: Status 404 returned error can't find the container with id e77b0218d0c89e91beb0bc05842c10f173353f37c7a5644a9531aa23b76b7f50
Jul 02 23:12:44.580062 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:44.580024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-855df44cff-vfm62" event={"ID":"39a404e4-fcd5-4754-9b8c-f8a426960e4b","Type":"ContainerStarted","Data":"e77b0218d0c89e91beb0bc05842c10f173353f37c7a5644a9531aa23b76b7f50"}
Jul 02 23:12:47.595968 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:47.595903    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d99c78947-xg22c" event={"ID":"83ff64b4-be9a-426f-8577-8f2f71d0a1a1","Type":"ContainerStarted","Data":"a211a3b1f4130751a0a6a4082d86748a600b4eac2835d1b200162632a8534a28"}
Jul 02 23:12:47.597862 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:47.597832    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-855df44cff-vfm62" event={"ID":"39a404e4-fcd5-4754-9b8c-f8a426960e4b","Type":"ContainerStarted","Data":"0c84f14ed8066249c3114b4cc2875b0ff126d4daaaba847bfc261657bc0e0b44"}
Jul 02 23:12:47.618091 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:47.618031    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d99c78947-xg22c" podStartSLOduration=7.598404062 podStartE2EDuration="11.618012624s" totalImagesPullingTime="4.019608562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:47.616206981 +0000 UTC m=+116.240625357" watchObservedRunningTime="2026-07-02 23:12:47.618012624 +0000 UTC m=+116.242431001"
Jul 02 23:12:47.636590 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:47.636534    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-855df44cff-vfm62" podStartSLOduration=2.383148986 podStartE2EDuration="4.636516404s" totalImagesPullingTime="2.253367418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:47.634638962 +0000 UTC m=+116.259057339" watchObservedRunningTime="2026-07-02 23:12:47.636516404 +0000 UTC m=+116.260934826"
Jul 02 23:12:48.604601 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:48.604568    2563 generic.go:356] "Generic (PLEG): container finished" podID="ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad" containerID="930daa0dc62fa77a22f2993a4b761340f4cbc4d7927753ce72b46beab4f0fa04" exitCode=0
Jul 02 23:12:48.605071 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:48.604659    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8" event={"ID":"ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad","Type":"ContainerDied","Data":"930daa0dc62fa77a22f2993a4b761340f4cbc4d7927753ce72b46beab4f0fa04"}
Jul 02 23:12:48.605257 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:48.605236    2563 scope.go:117] "RemoveContainer" containerID="930daa0dc62fa77a22f2993a4b761340f4cbc4d7927753ce72b46beab4f0fa04"
Jul 02 23:12:49.611881 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:49.611846    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r6cz8" event={"ID":"ef3f2606-899f-4946-b1b5-9bc4b8b5c2ad","Type":"ContainerStarted","Data":"e3d8e5e56db89c1278e59a9e30c1b757de6bc5a14dda1ca1a49e2a24f520eecf"}
Jul 02 23:12:50.710832 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:50.710788    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-86677c8bd8-rsngf" podUID="a16baa0f-554a-469b-a393-d447c0bae9f2" containerName="registry" containerID="cri-o://47241245bb1dfcf5078e9c3034b048cc29f0bf28dd9a4d3350ca8d8891b372ec" gracePeriod=30
Jul 02 23:12:51.011044 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.011014    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:12:51.189169 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.189134    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtz8n\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-kube-api-access-jtz8n\") pod \"a16baa0f-554a-469b-a393-d447c0bae9f2\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") "
Jul 02 23:12:51.189341 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.189178    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-certificates\") pod \"a16baa0f-554a-469b-a393-d447c0bae9f2\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") "
Jul 02 23:12:51.189341 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.189216    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-installation-pull-secrets\") pod \"a16baa0f-554a-469b-a393-d447c0bae9f2\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") "
Jul 02 23:12:51.189341 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.189242    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-bound-sa-token\") pod \"a16baa0f-554a-469b-a393-d447c0bae9f2\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") "
Jul 02 23:12:51.189687 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.189640    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a16baa0f-554a-469b-a393-d447c0bae9f2" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:12:51.189687 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.189661    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls\") pod \"a16baa0f-554a-469b-a393-d447c0bae9f2\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") "
Jul 02 23:12:51.190052 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.190022    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a16baa0f-554a-469b-a393-d447c0bae9f2-ca-trust-extracted\") pod \"a16baa0f-554a-469b-a393-d447c0bae9f2\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") "
Jul 02 23:12:51.191855 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.191739    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a16baa0f-554a-469b-a393-d447c0bae9f2-trusted-ca\") pod \"a16baa0f-554a-469b-a393-d447c0bae9f2\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") "
Jul 02 23:12:51.192083 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.192006    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a16baa0f-554a-469b-a393-d447c0bae9f2" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:12:51.192324 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.192135    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a16baa0f-554a-469b-a393-d447c0bae9f2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a16baa0f-554a-469b-a393-d447c0bae9f2" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:12:51.192324 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.191814    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-image-registry-private-configuration\") pod \"a16baa0f-554a-469b-a393-d447c0bae9f2\" (UID: \"a16baa0f-554a-469b-a393-d447c0bae9f2\") "
Jul 02 23:12:51.192455 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.192421    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a16baa0f-554a-469b-a393-d447c0bae9f2-trusted-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:12:51.192455 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.192444    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-certificates\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:12:51.192543 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.192460    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-bound-sa-token\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:12:51.193341 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.193311    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a16baa0f-554a-469b-a393-d447c0bae9f2" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:12:51.193460 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.193412    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a16baa0f-554a-469b-a393-d447c0bae9f2" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:12:51.193460 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.193440    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-kube-api-access-jtz8n" (OuterVolumeSpecName: "kube-api-access-jtz8n") pod "a16baa0f-554a-469b-a393-d447c0bae9f2" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2"). InnerVolumeSpecName "kube-api-access-jtz8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:12:51.194357 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.194322    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a16baa0f-554a-469b-a393-d447c0bae9f2" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:12:51.203026 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.203000    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16baa0f-554a-469b-a393-d447c0bae9f2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a16baa0f-554a-469b-a393-d447c0bae9f2" (UID: "a16baa0f-554a-469b-a393-d447c0bae9f2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:12:51.293591 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.293520    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtz8n\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-kube-api-access-jtz8n\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:12:51.293591 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.293552    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-installation-pull-secrets\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:12:51.293591 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.293563    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a16baa0f-554a-469b-a393-d447c0bae9f2-registry-tls\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:12:51.293591 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.293573    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a16baa0f-554a-469b-a393-d447c0bae9f2-ca-trust-extracted\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:12:51.293591 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.293582    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a16baa0f-554a-469b-a393-d447c0bae9f2-image-registry-private-configuration\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:12:51.621769 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.621729    2563 generic.go:356] "Generic (PLEG): container finished" podID="a16baa0f-554a-469b-a393-d447c0bae9f2" containerID="47241245bb1dfcf5078e9c3034b048cc29f0bf28dd9a4d3350ca8d8891b372ec" exitCode=0
Jul 02 23:12:51.621951 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.621783    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86677c8bd8-rsngf" event={"ID":"a16baa0f-554a-469b-a393-d447c0bae9f2","Type":"ContainerDied","Data":"47241245bb1dfcf5078e9c3034b048cc29f0bf28dd9a4d3350ca8d8891b372ec"}
Jul 02 23:12:51.621951 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.621800    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86677c8bd8-rsngf"
Jul 02 23:12:51.621951 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.621885    2563 scope.go:117] "RemoveContainer" containerID="47241245bb1dfcf5078e9c3034b048cc29f0bf28dd9a4d3350ca8d8891b372ec"
Jul 02 23:12:51.622118 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.621872    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86677c8bd8-rsngf" event={"ID":"a16baa0f-554a-469b-a393-d447c0bae9f2","Type":"ContainerDied","Data":"0d490cea437fcb706eae2a0df1809d1ded0603022b55c79215855df32dded0c5"}
Jul 02 23:12:51.631755 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.631732    2563 scope.go:117] "RemoveContainer" containerID="47241245bb1dfcf5078e9c3034b048cc29f0bf28dd9a4d3350ca8d8891b372ec"
Jul 02 23:12:51.632087 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:12:51.632059    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47241245bb1dfcf5078e9c3034b048cc29f0bf28dd9a4d3350ca8d8891b372ec\": container with ID starting with 47241245bb1dfcf5078e9c3034b048cc29f0bf28dd9a4d3350ca8d8891b372ec not found: ID does not exist" containerID="47241245bb1dfcf5078e9c3034b048cc29f0bf28dd9a4d3350ca8d8891b372ec"
Jul 02 23:12:51.632199 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.632093    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47241245bb1dfcf5078e9c3034b048cc29f0bf28dd9a4d3350ca8d8891b372ec"} err="failed to get container status \"47241245bb1dfcf5078e9c3034b048cc29f0bf28dd9a4d3350ca8d8891b372ec\": rpc error: code = NotFound desc = could not find container \"47241245bb1dfcf5078e9c3034b048cc29f0bf28dd9a4d3350ca8d8891b372ec\": container with ID starting with 47241245bb1dfcf5078e9c3034b048cc29f0bf28dd9a4d3350ca8d8891b372ec not found: ID does not exist"
Jul 02 23:12:51.645071 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.645050    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86677c8bd8-rsngf"]
Jul 02 23:12:51.648545 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.648523    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-86677c8bd8-rsngf"]
Jul 02 23:12:51.885467 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:51.885399    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a16baa0f-554a-469b-a393-d447c0bae9f2" path="/var/lib/kubelet/pods/a16baa0f-554a-469b-a393-d447c0bae9f2/volumes"
Jul 02 23:12:54.147221 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:54.147189    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:54.147644 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:54.147235    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:54.152148 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:54.152119    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:54.635663 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:54.635631    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:12:54.680736 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:54.680706    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d99c78947-xg22c"]
Jul 02 23:12:56.558253 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:56.558216    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:12:57.644035 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:57.644003    2563 generic.go:356] "Generic (PLEG): container finished" podID="a3f9c3bd-e3f0-4b40-885e-568e2fe525ba" containerID="6c815328ef1f26ea6d87ef49f2eeadeed1560db17c17452bb51ecc6c6f1470fb" exitCode=0
Jul 02 23:12:57.644377 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:57.644078    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln" event={"ID":"a3f9c3bd-e3f0-4b40-885e-568e2fe525ba","Type":"ContainerDied","Data":"6c815328ef1f26ea6d87ef49f2eeadeed1560db17c17452bb51ecc6c6f1470fb"}
Jul 02 23:12:57.644424 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:57.644399    2563 scope.go:117] "RemoveContainer" containerID="6c815328ef1f26ea6d87ef49f2eeadeed1560db17c17452bb51ecc6c6f1470fb"
Jul 02 23:12:58.650189 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:12:58.650156    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-bgzln" event={"ID":"a3f9c3bd-e3f0-4b40-885e-568e2fe525ba","Type":"ContainerStarted","Data":"c6cbaf1c2767c2d5e65d51f1c57cb66707513fae8e1c4dd19bd5250c8df172d5"}
Jul 02 23:13:02.666196 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:02.666166    2563 generic.go:356] "Generic (PLEG): container finished" podID="9874c716-714c-46b7-a814-a4634c608e26" containerID="79ba6370c92c2f4404684d348e9ee0a23aa0cfe7c44293c154f8f014af913dcf" exitCode=0
Jul 02 23:13:02.666634 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:02.666252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj" event={"ID":"9874c716-714c-46b7-a814-a4634c608e26","Type":"ContainerDied","Data":"79ba6370c92c2f4404684d348e9ee0a23aa0cfe7c44293c154f8f014af913dcf"}
Jul 02 23:13:02.666634 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:02.666624    2563 scope.go:117] "RemoveContainer" containerID="79ba6370c92c2f4404684d348e9ee0a23aa0cfe7c44293c154f8f014af913dcf"
Jul 02 23:13:03.671802 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:03.671767    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-bw4cj" event={"ID":"9874c716-714c-46b7-a814-a4634c608e26","Type":"ContainerStarted","Data":"bf48c3a7a57f53a2dca8213bc3826dafcfb223a6ff6ed079b911a23e2a8ace27"}
Jul 02 23:13:19.703334 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:19.703280    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d99c78947-xg22c" podUID="83ff64b4-be9a-426f-8577-8f2f71d0a1a1" containerName="console" containerID="cri-o://a211a3b1f4130751a0a6a4082d86748a600b4eac2835d1b200162632a8534a28" gracePeriod=15
Jul 02 23:13:19.985446 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:19.985369    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:13:20.015836 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.015808    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-oauth-serving-cert\") pod \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") "
Jul 02 23:13:20.016026 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.015843    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-config\") pod \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") "
Jul 02 23:13:20.016026 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.015884    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mv8g\" (UniqueName: \"kubernetes.io/projected/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-kube-api-access-6mv8g\") pod \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") "
Jul 02 23:13:20.016026 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.015901    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-service-ca\") pod \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") "
Jul 02 23:13:20.016026 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.015958    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-oauth-config\") pod \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") "
Jul 02 23:13:20.016026 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.015988    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-serving-cert\") pod \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\" (UID: \"83ff64b4-be9a-426f-8577-8f2f71d0a1a1\") "
Jul 02 23:13:20.016357 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.016336    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "83ff64b4-be9a-426f-8577-8f2f71d0a1a1" (UID: "83ff64b4-be9a-426f-8577-8f2f71d0a1a1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:13:20.016435 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.016338    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-config" (OuterVolumeSpecName: "console-config") pod "83ff64b4-be9a-426f-8577-8f2f71d0a1a1" (UID: "83ff64b4-be9a-426f-8577-8f2f71d0a1a1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:13:20.016435 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.016350    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-service-ca" (OuterVolumeSpecName: "service-ca") pod "83ff64b4-be9a-426f-8577-8f2f71d0a1a1" (UID: "83ff64b4-be9a-426f-8577-8f2f71d0a1a1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:13:20.018453 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.018423    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "83ff64b4-be9a-426f-8577-8f2f71d0a1a1" (UID: "83ff64b4-be9a-426f-8577-8f2f71d0a1a1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:13:20.018547 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.018490    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "83ff64b4-be9a-426f-8577-8f2f71d0a1a1" (UID: "83ff64b4-be9a-426f-8577-8f2f71d0a1a1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:13:20.018547 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.018501    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-kube-api-access-6mv8g" (OuterVolumeSpecName: "kube-api-access-6mv8g") pod "83ff64b4-be9a-426f-8577-8f2f71d0a1a1" (UID: "83ff64b4-be9a-426f-8577-8f2f71d0a1a1"). InnerVolumeSpecName "kube-api-access-6mv8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:13:20.117221 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.117185    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mv8g\" (UniqueName: \"kubernetes.io/projected/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-kube-api-access-6mv8g\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:13:20.117221 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.117215    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:13:20.117221 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.117230    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-oauth-config\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:13:20.117456 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.117243    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-serving-cert\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:13:20.117456 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.117254    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-oauth-serving-cert\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:13:20.117456 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.117266    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/83ff64b4-be9a-426f-8577-8f2f71d0a1a1-console-config\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:13:20.739138 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.739105    2563 generic.go:356] "Generic (PLEG): container finished" podID="83ff64b4-be9a-426f-8577-8f2f71d0a1a1" containerID="a211a3b1f4130751a0a6a4082d86748a600b4eac2835d1b200162632a8534a28" exitCode=0
Jul 02 23:13:20.739138 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.739143    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d99c78947-xg22c" event={"ID":"83ff64b4-be9a-426f-8577-8f2f71d0a1a1","Type":"ContainerDied","Data":"a211a3b1f4130751a0a6a4082d86748a600b4eac2835d1b200162632a8534a28"}
Jul 02 23:13:20.739662 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.739155    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d99c78947-xg22c"
Jul 02 23:13:20.739662 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.739184    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d99c78947-xg22c" event={"ID":"83ff64b4-be9a-426f-8577-8f2f71d0a1a1","Type":"ContainerDied","Data":"8395944e0051c22219a267e66804e41dad58ee105b87d6d81948643c5654c7e7"}
Jul 02 23:13:20.739662 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.739203    2563 scope.go:117] "RemoveContainer" containerID="a211a3b1f4130751a0a6a4082d86748a600b4eac2835d1b200162632a8534a28"
Jul 02 23:13:20.747406 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.747390    2563 scope.go:117] "RemoveContainer" containerID="a211a3b1f4130751a0a6a4082d86748a600b4eac2835d1b200162632a8534a28"
Jul 02 23:13:20.747660 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:13:20.747638    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a211a3b1f4130751a0a6a4082d86748a600b4eac2835d1b200162632a8534a28\": container with ID starting with a211a3b1f4130751a0a6a4082d86748a600b4eac2835d1b200162632a8534a28 not found: ID does not exist" containerID="a211a3b1f4130751a0a6a4082d86748a600b4eac2835d1b200162632a8534a28"
Jul 02 23:13:20.747716 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.747669    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a211a3b1f4130751a0a6a4082d86748a600b4eac2835d1b200162632a8534a28"} err="failed to get container status \"a211a3b1f4130751a0a6a4082d86748a600b4eac2835d1b200162632a8534a28\": rpc error: code = NotFound desc = could not find container \"a211a3b1f4130751a0a6a4082d86748a600b4eac2835d1b200162632a8534a28\": container with ID starting with a211a3b1f4130751a0a6a4082d86748a600b4eac2835d1b200162632a8534a28 not found: ID does not exist"
Jul 02 23:13:20.759526 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.759497    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d99c78947-xg22c"]
Jul 02 23:13:20.762957 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:20.762935    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d99c78947-xg22c"]
Jul 02 23:13:21.884963 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:13:21.884907    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83ff64b4-be9a-426f-8577-8f2f71d0a1a1" path="/var/lib/kubelet/pods/83ff64b4-be9a-426f-8577-8f2f71d0a1a1/volumes"
Jul 02 23:14:06.059850 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.059804    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cc4f747c5-2sq7r"]
Jul 02 23:14:06.060437 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.060240    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16baa0f-554a-469b-a393-d447c0bae9f2" containerName="registry"
Jul 02 23:14:06.060437 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.060261    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16baa0f-554a-469b-a393-d447c0bae9f2" containerName="registry"
Jul 02 23:14:06.060437 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.060287    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83ff64b4-be9a-426f-8577-8f2f71d0a1a1" containerName="console"
Jul 02 23:14:06.060437 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.060295    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="83ff64b4-be9a-426f-8577-8f2f71d0a1a1" containerName="console"
Jul 02 23:14:06.060437 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.060375    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="83ff64b4-be9a-426f-8577-8f2f71d0a1a1" containerName="console"
Jul 02 23:14:06.060437 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.060390    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a16baa0f-554a-469b-a393-d447c0bae9f2" containerName="registry"
Jul 02 23:14:06.063345 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.063320    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.077362 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.077333    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc4f747c5-2sq7r"]
Jul 02 23:14:06.184237 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.184202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-service-ca\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.184403 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.184250    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-trusted-ca-bundle\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.184403 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.184330    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/808050fa-434c-4a6b-9980-dcb41914e2a1-console-oauth-config\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.184403 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.184346    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-oauth-serving-cert\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.184403 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.184365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-console-config\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.184537 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.184410    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/808050fa-434c-4a6b-9980-dcb41914e2a1-console-serving-cert\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.184537 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.184446    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7bbp\" (UniqueName: \"kubernetes.io/projected/808050fa-434c-4a6b-9980-dcb41914e2a1-kube-api-access-c7bbp\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.285194 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.285147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7bbp\" (UniqueName: \"kubernetes.io/projected/808050fa-434c-4a6b-9980-dcb41914e2a1-kube-api-access-c7bbp\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.285343 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.285207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-service-ca\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.285343 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.285244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-trusted-ca-bundle\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.285343 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.285287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/808050fa-434c-4a6b-9980-dcb41914e2a1-console-oauth-config\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.285343 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.285311    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-oauth-serving-cert\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.285343 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.285334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-console-config\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.285562 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.285376    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/808050fa-434c-4a6b-9980-dcb41914e2a1-console-serving-cert\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.286144 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.286112    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-service-ca\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.286276 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.286196    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-oauth-serving-cert\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.286276 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.286212    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-console-config\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.286276 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.286205    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-trusted-ca-bundle\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.287980 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.287959    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/808050fa-434c-4a6b-9980-dcb41914e2a1-console-serving-cert\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.288092 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.287994    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/808050fa-434c-4a6b-9980-dcb41914e2a1-console-oauth-config\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.296285 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.296264    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7bbp\" (UniqueName: \"kubernetes.io/projected/808050fa-434c-4a6b-9980-dcb41914e2a1-kube-api-access-c7bbp\") pod \"console-6cc4f747c5-2sq7r\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") " pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.373391 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.373360    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:06.502965 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.502940    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc4f747c5-2sq7r"]
Jul 02 23:14:06.505107 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:14:06.505083    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808050fa_434c_4a6b_9980_dcb41914e2a1.slice/crio-85fa7c4b061c9a87a8163e07beadc95ae3c9b0e9f720a4b4e44bd0222a5556d7 WatchSource:0}: Error finding container 85fa7c4b061c9a87a8163e07beadc95ae3c9b0e9f720a4b4e44bd0222a5556d7: Status 404 returned error can't find the container with id 85fa7c4b061c9a87a8163e07beadc95ae3c9b0e9f720a4b4e44bd0222a5556d7
Jul 02 23:14:06.918647 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.918612    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc4f747c5-2sq7r" event={"ID":"808050fa-434c-4a6b-9980-dcb41914e2a1","Type":"ContainerStarted","Data":"1a93b82bcd627a7b35f878bf825d0fc1d83e6751830fff2cffe4fcbcc69561ab"}
Jul 02 23:14:06.918836 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.918657    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc4f747c5-2sq7r" event={"ID":"808050fa-434c-4a6b-9980-dcb41914e2a1","Type":"ContainerStarted","Data":"85fa7c4b061c9a87a8163e07beadc95ae3c9b0e9f720a4b4e44bd0222a5556d7"}
Jul 02 23:14:06.940653 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:06.940602    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cc4f747c5-2sq7r" podStartSLOduration=0.940586032 podStartE2EDuration="940.586032ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:14:06.939126238 +0000 UTC m=+195.563544616" watchObservedRunningTime="2026-07-02 23:14:06.940586032 +0000 UTC m=+195.565004407"
Jul 02 23:14:16.374417 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:16.374378    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:16.374836 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:16.374455    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:16.379238 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:16.379213    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:16.959872 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:16.959846    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:14:17.004841 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:17.004810    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-855df44cff-vfm62"]
Jul 02 23:14:19.534022 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.533987    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"]
Jul 02 23:14:19.539295 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.539272    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"
Jul 02 23:14:19.542280 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.542259    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 02 23:14:19.542424 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.542380    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 02 23:14:19.543581 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.543558    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wdwfr\""
Jul 02 23:14:19.545769 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.545745    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"]
Jul 02 23:14:19.584563 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.584538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25b4fb34-42d6-402b-895b-519679235625-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw\" (UID: \"25b4fb34-42d6-402b-895b-519679235625\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"
Jul 02 23:14:19.584713 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.584573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25b4fb34-42d6-402b-895b-519679235625-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw\" (UID: \"25b4fb34-42d6-402b-895b-519679235625\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"
Jul 02 23:14:19.584713 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.584612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv6wf\" (UniqueName: \"kubernetes.io/projected/25b4fb34-42d6-402b-895b-519679235625-kube-api-access-pv6wf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw\" (UID: \"25b4fb34-42d6-402b-895b-519679235625\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"
Jul 02 23:14:19.685675 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.685639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv6wf\" (UniqueName: \"kubernetes.io/projected/25b4fb34-42d6-402b-895b-519679235625-kube-api-access-pv6wf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw\" (UID: \"25b4fb34-42d6-402b-895b-519679235625\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"
Jul 02 23:14:19.685818 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.685701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25b4fb34-42d6-402b-895b-519679235625-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw\" (UID: \"25b4fb34-42d6-402b-895b-519679235625\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"
Jul 02 23:14:19.685818 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.685731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25b4fb34-42d6-402b-895b-519679235625-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw\" (UID: \"25b4fb34-42d6-402b-895b-519679235625\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"
Jul 02 23:14:19.686092 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.686076    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25b4fb34-42d6-402b-895b-519679235625-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw\" (UID: \"25b4fb34-42d6-402b-895b-519679235625\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"
Jul 02 23:14:19.686136 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.686116    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25b4fb34-42d6-402b-895b-519679235625-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw\" (UID: \"25b4fb34-42d6-402b-895b-519679235625\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"
Jul 02 23:14:19.694503 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.694477    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv6wf\" (UniqueName: \"kubernetes.io/projected/25b4fb34-42d6-402b-895b-519679235625-kube-api-access-pv6wf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw\" (UID: \"25b4fb34-42d6-402b-895b-519679235625\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"
Jul 02 23:14:19.849489 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.849456    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"
Jul 02 23:14:19.989598 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:19.989569    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"]
Jul 02 23:14:19.991831 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:14:19.991798    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b4fb34_42d6_402b_895b_519679235625.slice/crio-175f4cddec5b0ce1021af1202ed7f2bb3bf378e8f9ecc699ed9b0331afe3d0ad WatchSource:0}: Error finding container 175f4cddec5b0ce1021af1202ed7f2bb3bf378e8f9ecc699ed9b0331afe3d0ad: Status 404 returned error can't find the container with id 175f4cddec5b0ce1021af1202ed7f2bb3bf378e8f9ecc699ed9b0331afe3d0ad
Jul 02 23:14:20.973027 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:20.972988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw" event={"ID":"25b4fb34-42d6-402b-895b-519679235625","Type":"ContainerStarted","Data":"175f4cddec5b0ce1021af1202ed7f2bb3bf378e8f9ecc699ed9b0331afe3d0ad"}
Jul 02 23:14:26.998129 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:26.998091    2563 generic.go:356] "Generic (PLEG): container finished" podID="25b4fb34-42d6-402b-895b-519679235625" containerID="ae2dfd1b524c5eaf6cd43cd02b31b150719241cd361a6b9eb3bb4a81a07b756d" exitCode=0
Jul 02 23:14:26.998503 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:26.998139    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw" event={"ID":"25b4fb34-42d6-402b-895b-519679235625","Type":"ContainerDied","Data":"ae2dfd1b524c5eaf6cd43cd02b31b150719241cd361a6b9eb3bb4a81a07b756d"}
Jul 02 23:14:29.008056 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:29.008021    2563 generic.go:356] "Generic (PLEG): container finished" podID="25b4fb34-42d6-402b-895b-519679235625" containerID="d40e426828b22c62a02a4808e41a4c660718430389f74299eb970fda7359b6a4" exitCode=0
Jul 02 23:14:29.008401 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:29.008077    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw" event={"ID":"25b4fb34-42d6-402b-895b-519679235625","Type":"ContainerDied","Data":"d40e426828b22c62a02a4808e41a4c660718430389f74299eb970fda7359b6a4"}
Jul 02 23:14:38.048011 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:38.047972    2563 generic.go:356] "Generic (PLEG): container finished" podID="25b4fb34-42d6-402b-895b-519679235625" containerID="1f7f143f0a6c2f59aecf770c002db987c294ed426c01c2db4326d0a1b8bfe6cf" exitCode=0
Jul 02 23:14:38.048416 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:38.048074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw" event={"ID":"25b4fb34-42d6-402b-895b-519679235625","Type":"ContainerDied","Data":"1f7f143f0a6c2f59aecf770c002db987c294ed426c01c2db4326d0a1b8bfe6cf"}
Jul 02 23:14:39.185462 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:39.185440    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"
Jul 02 23:14:39.257510 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:39.257485    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25b4fb34-42d6-402b-895b-519679235625-util\") pod \"25b4fb34-42d6-402b-895b-519679235625\" (UID: \"25b4fb34-42d6-402b-895b-519679235625\") "
Jul 02 23:14:39.257687 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:39.257544    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv6wf\" (UniqueName: \"kubernetes.io/projected/25b4fb34-42d6-402b-895b-519679235625-kube-api-access-pv6wf\") pod \"25b4fb34-42d6-402b-895b-519679235625\" (UID: \"25b4fb34-42d6-402b-895b-519679235625\") "
Jul 02 23:14:39.257687 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:39.257571    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25b4fb34-42d6-402b-895b-519679235625-bundle\") pod \"25b4fb34-42d6-402b-895b-519679235625\" (UID: \"25b4fb34-42d6-402b-895b-519679235625\") "
Jul 02 23:14:39.258310 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:39.258288    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b4fb34-42d6-402b-895b-519679235625-bundle" (OuterVolumeSpecName: "bundle") pod "25b4fb34-42d6-402b-895b-519679235625" (UID: "25b4fb34-42d6-402b-895b-519679235625"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:14:39.259683 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:39.259662    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b4fb34-42d6-402b-895b-519679235625-kube-api-access-pv6wf" (OuterVolumeSpecName: "kube-api-access-pv6wf") pod "25b4fb34-42d6-402b-895b-519679235625" (UID: "25b4fb34-42d6-402b-895b-519679235625"). InnerVolumeSpecName "kube-api-access-pv6wf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:14:39.261858 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:39.261827    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25b4fb34-42d6-402b-895b-519679235625-util" (OuterVolumeSpecName: "util") pod "25b4fb34-42d6-402b-895b-519679235625" (UID: "25b4fb34-42d6-402b-895b-519679235625"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:14:39.358276 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:39.358251    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25b4fb34-42d6-402b-895b-519679235625-util\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:14:39.358276 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:39.358275    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv6wf\" (UniqueName: \"kubernetes.io/projected/25b4fb34-42d6-402b-895b-519679235625-kube-api-access-pv6wf\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:14:39.358412 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:39.358285    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25b4fb34-42d6-402b-895b-519679235625-bundle\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:14:40.057407 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:40.057376    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw" event={"ID":"25b4fb34-42d6-402b-895b-519679235625","Type":"ContainerDied","Data":"175f4cddec5b0ce1021af1202ed7f2bb3bf378e8f9ecc699ed9b0331afe3d0ad"}
Jul 02 23:14:40.057570 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:40.057424    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="175f4cddec5b0ce1021af1202ed7f2bb3bf378e8f9ecc699ed9b0331afe3d0ad"
Jul 02 23:14:40.057570 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:40.057384    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dc5cw"
Jul 02 23:14:42.031286 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.031248    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-855df44cff-vfm62" podUID="39a404e4-fcd5-4754-9b8c-f8a426960e4b" containerName="console" containerID="cri-o://0c84f14ed8066249c3114b4cc2875b0ff126d4daaaba847bfc261657bc0e0b44" gracePeriod=15
Jul 02 23:14:42.299999 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.299943    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:14:42.383674 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.383647    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-service-ca\") pod \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") "
Jul 02 23:14:42.383674 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.383681    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-trusted-ca-bundle\") pod \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") "
Jul 02 23:14:42.383841 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.383718    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmctm\" (UniqueName: \"kubernetes.io/projected/39a404e4-fcd5-4754-9b8c-f8a426960e4b-kube-api-access-jmctm\") pod \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") "
Jul 02 23:14:42.383841 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.383818    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-oauth-serving-cert\") pod \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") "
Jul 02 23:14:42.383953 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.383866    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-serving-cert\") pod \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") "
Jul 02 23:14:42.383953 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.383930    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-oauth-config\") pod \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") "
Jul 02 23:14:42.384067 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.384022    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-config\") pod \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\" (UID: \"39a404e4-fcd5-4754-9b8c-f8a426960e4b\") "
Jul 02 23:14:42.384160 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.384049    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-service-ca" (OuterVolumeSpecName: "service-ca") pod "39a404e4-fcd5-4754-9b8c-f8a426960e4b" (UID: "39a404e4-fcd5-4754-9b8c-f8a426960e4b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:14:42.384292 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.384250    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "39a404e4-fcd5-4754-9b8c-f8a426960e4b" (UID: "39a404e4-fcd5-4754-9b8c-f8a426960e4b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:14:42.384292 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.384277    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:14:42.384394 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.384349    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-config" (OuterVolumeSpecName: "console-config") pod "39a404e4-fcd5-4754-9b8c-f8a426960e4b" (UID: "39a404e4-fcd5-4754-9b8c-f8a426960e4b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:14:42.384394 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.384358    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "39a404e4-fcd5-4754-9b8c-f8a426960e4b" (UID: "39a404e4-fcd5-4754-9b8c-f8a426960e4b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:14:42.385844 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.385821    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39a404e4-fcd5-4754-9b8c-f8a426960e4b-kube-api-access-jmctm" (OuterVolumeSpecName: "kube-api-access-jmctm") pod "39a404e4-fcd5-4754-9b8c-f8a426960e4b" (UID: "39a404e4-fcd5-4754-9b8c-f8a426960e4b"). InnerVolumeSpecName "kube-api-access-jmctm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:14:42.386371 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.386351    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "39a404e4-fcd5-4754-9b8c-f8a426960e4b" (UID: "39a404e4-fcd5-4754-9b8c-f8a426960e4b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:14:42.386459 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.386364    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "39a404e4-fcd5-4754-9b8c-f8a426960e4b" (UID: "39a404e4-fcd5-4754-9b8c-f8a426960e4b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:14:42.484739 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.484717    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-config\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:14:42.484739 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.484737    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-trusted-ca-bundle\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:14:42.484867 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.484746    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmctm\" (UniqueName: \"kubernetes.io/projected/39a404e4-fcd5-4754-9b8c-f8a426960e4b-kube-api-access-jmctm\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:14:42.484867 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.484755    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/39a404e4-fcd5-4754-9b8c-f8a426960e4b-oauth-serving-cert\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:14:42.484867 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.484764    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-serving-cert\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:14:42.484867 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:42.484772    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/39a404e4-fcd5-4754-9b8c-f8a426960e4b-console-oauth-config\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:14:43.068953 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:43.068903    2563 generic.go:356] "Generic (PLEG): container finished" podID="39a404e4-fcd5-4754-9b8c-f8a426960e4b" containerID="0c84f14ed8066249c3114b4cc2875b0ff126d4daaaba847bfc261657bc0e0b44" exitCode=0
Jul 02 23:14:43.068953 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:43.068957    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-855df44cff-vfm62" event={"ID":"39a404e4-fcd5-4754-9b8c-f8a426960e4b","Type":"ContainerDied","Data":"0c84f14ed8066249c3114b4cc2875b0ff126d4daaaba847bfc261657bc0e0b44"}
Jul 02 23:14:43.069417 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:43.068978    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-855df44cff-vfm62"
Jul 02 23:14:43.069417 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:43.068998    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-855df44cff-vfm62" event={"ID":"39a404e4-fcd5-4754-9b8c-f8a426960e4b","Type":"ContainerDied","Data":"e77b0218d0c89e91beb0bc05842c10f173353f37c7a5644a9531aa23b76b7f50"}
Jul 02 23:14:43.069417 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:43.069016    2563 scope.go:117] "RemoveContainer" containerID="0c84f14ed8066249c3114b4cc2875b0ff126d4daaaba847bfc261657bc0e0b44"
Jul 02 23:14:43.077807 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:43.077788    2563 scope.go:117] "RemoveContainer" containerID="0c84f14ed8066249c3114b4cc2875b0ff126d4daaaba847bfc261657bc0e0b44"
Jul 02 23:14:43.078075 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:14:43.078058    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c84f14ed8066249c3114b4cc2875b0ff126d4daaaba847bfc261657bc0e0b44\": container with ID starting with 0c84f14ed8066249c3114b4cc2875b0ff126d4daaaba847bfc261657bc0e0b44 not found: ID does not exist" containerID="0c84f14ed8066249c3114b4cc2875b0ff126d4daaaba847bfc261657bc0e0b44"
Jul 02 23:14:43.078138 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:43.078083    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c84f14ed8066249c3114b4cc2875b0ff126d4daaaba847bfc261657bc0e0b44"} err="failed to get container status \"0c84f14ed8066249c3114b4cc2875b0ff126d4daaaba847bfc261657bc0e0b44\": rpc error: code = NotFound desc = could not find container \"0c84f14ed8066249c3114b4cc2875b0ff126d4daaaba847bfc261657bc0e0b44\": container with ID starting with 0c84f14ed8066249c3114b4cc2875b0ff126d4daaaba847bfc261657bc0e0b44 not found: ID does not exist"
Jul 02 23:14:43.091084 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:43.091058    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-855df44cff-vfm62"]
Jul 02 23:14:43.096536 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:43.096515    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-855df44cff-vfm62"]
Jul 02 23:14:43.884934 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:43.884889    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39a404e4-fcd5-4754-9b8c-f8a426960e4b" path="/var/lib/kubelet/pods/39a404e4-fcd5-4754-9b8c-f8a426960e4b/volumes"
Jul 02 23:14:47.683591 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.683553    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gth48"]
Jul 02 23:14:47.684094 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.684054    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b4fb34-42d6-402b-895b-519679235625" containerName="extract"
Jul 02 23:14:47.684094 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.684086    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b4fb34-42d6-402b-895b-519679235625" containerName="extract"
Jul 02 23:14:47.684214 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.684107    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b4fb34-42d6-402b-895b-519679235625" containerName="pull"
Jul 02 23:14:47.684214 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.684116    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b4fb34-42d6-402b-895b-519679235625" containerName="pull"
Jul 02 23:14:47.684214 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.684135    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39a404e4-fcd5-4754-9b8c-f8a426960e4b" containerName="console"
Jul 02 23:14:47.684214 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.684143    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="39a404e4-fcd5-4754-9b8c-f8a426960e4b" containerName="console"
Jul 02 23:14:47.684214 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.684158    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b4fb34-42d6-402b-895b-519679235625" containerName="util"
Jul 02 23:14:47.684214 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.684166    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b4fb34-42d6-402b-895b-519679235625" containerName="util"
Jul 02 23:14:47.684480 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.684247    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="39a404e4-fcd5-4754-9b8c-f8a426960e4b" containerName="console"
Jul 02 23:14:47.684480 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.684261    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b4fb34-42d6-402b-895b-519679235625" containerName="extract"
Jul 02 23:14:47.686185 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.686164    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gth48"
Jul 02 23:14:47.690095 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.690076    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vzm57\""
Jul 02 23:14:47.691107 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.691091    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:14:47.693351 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.693335    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 02 23:14:47.707541 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.707519    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gth48"]
Jul 02 23:14:47.829632 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.829598    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hftl2\" (UniqueName: \"kubernetes.io/projected/a77fb23d-73f7-4cc2-b693-690fd26da83a-kube-api-access-hftl2\") pod \"cert-manager-operator-controller-manager-55c444bf86-gth48\" (UID: \"a77fb23d-73f7-4cc2-b693-690fd26da83a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gth48"
Jul 02 23:14:47.829765 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.829649    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a77fb23d-73f7-4cc2-b693-690fd26da83a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gth48\" (UID: \"a77fb23d-73f7-4cc2-b693-690fd26da83a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gth48"
Jul 02 23:14:47.930886 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.930857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hftl2\" (UniqueName: \"kubernetes.io/projected/a77fb23d-73f7-4cc2-b693-690fd26da83a-kube-api-access-hftl2\") pod \"cert-manager-operator-controller-manager-55c444bf86-gth48\" (UID: \"a77fb23d-73f7-4cc2-b693-690fd26da83a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gth48"
Jul 02 23:14:47.931041 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.930903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a77fb23d-73f7-4cc2-b693-690fd26da83a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gth48\" (UID: \"a77fb23d-73f7-4cc2-b693-690fd26da83a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gth48"
Jul 02 23:14:47.931232 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.931216    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a77fb23d-73f7-4cc2-b693-690fd26da83a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gth48\" (UID: \"a77fb23d-73f7-4cc2-b693-690fd26da83a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gth48"
Jul 02 23:14:47.946876 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.946826    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hftl2\" (UniqueName: \"kubernetes.io/projected/a77fb23d-73f7-4cc2-b693-690fd26da83a-kube-api-access-hftl2\") pod \"cert-manager-operator-controller-manager-55c444bf86-gth48\" (UID: \"a77fb23d-73f7-4cc2-b693-690fd26da83a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gth48"
Jul 02 23:14:47.994745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:47.994715    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gth48"
Jul 02 23:14:48.132992 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:48.132960    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gth48"]
Jul 02 23:14:48.137195 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:14:48.137166    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77fb23d_73f7_4cc2_b693_690fd26da83a.slice/crio-4fd4b18b82525cb55b3db62f0024093e3578e4205e5a553530cbd6f3497fdfcf WatchSource:0}: Error finding container 4fd4b18b82525cb55b3db62f0024093e3578e4205e5a553530cbd6f3497fdfcf: Status 404 returned error can't find the container with id 4fd4b18b82525cb55b3db62f0024093e3578e4205e5a553530cbd6f3497fdfcf
Jul 02 23:14:49.094742 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:49.094711    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gth48" event={"ID":"a77fb23d-73f7-4cc2-b693-690fd26da83a","Type":"ContainerStarted","Data":"4fd4b18b82525cb55b3db62f0024093e3578e4205e5a553530cbd6f3497fdfcf"}
Jul 02 23:14:52.114438 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:14:52.114405    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gth48" event={"ID":"a77fb23d-73f7-4cc2-b693-690fd26da83a","Type":"ContainerStarted","Data":"f944a951e993f6f31e78d0aa9c8862a3bf2f76f17780b34a2657f0a9f124f386"}
Jul 02 23:15:03.725496 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:03.725438    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gth48" podStartSLOduration=13.561233757 podStartE2EDuration="16.725421312s" totalImagesPullingTime="3.164187555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:14:52.147744793 +0000 UTC m=+240.772163169" watchObservedRunningTime="2026-07-02 23:15:03.725421312 +0000 UTC m=+252.349839688"
Jul 02 23:15:03.726710 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:03.726685    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cdxcz"]
Jul 02 23:15:03.729268 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:03.729250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-cdxcz"
Jul 02 23:15:03.733352 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:03.733330    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 02 23:15:03.733448 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:03.733337    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 02 23:15:03.733448 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:03.733409    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-zx2tp\""
Jul 02 23:15:03.744254 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:03.744228    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cdxcz"]
Jul 02 23:15:03.856546 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:03.856520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5828448b-8607-4c5a-b706-7cc8dc3327b8-bound-sa-token\") pod \"cert-manager-55b4d954d5-cdxcz\" (UID: \"5828448b-8607-4c5a-b706-7cc8dc3327b8\") " pod="cert-manager/cert-manager-55b4d954d5-cdxcz"
Jul 02 23:15:03.856684 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:03.856563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkp5h\" (UniqueName: \"kubernetes.io/projected/5828448b-8607-4c5a-b706-7cc8dc3327b8-kube-api-access-xkp5h\") pod \"cert-manager-55b4d954d5-cdxcz\" (UID: \"5828448b-8607-4c5a-b706-7cc8dc3327b8\") " pod="cert-manager/cert-manager-55b4d954d5-cdxcz"
Jul 02 23:15:03.957641 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:03.957615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5828448b-8607-4c5a-b706-7cc8dc3327b8-bound-sa-token\") pod \"cert-manager-55b4d954d5-cdxcz\" (UID: \"5828448b-8607-4c5a-b706-7cc8dc3327b8\") " pod="cert-manager/cert-manager-55b4d954d5-cdxcz"
Jul 02 23:15:03.957757 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:03.957663    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkp5h\" (UniqueName: \"kubernetes.io/projected/5828448b-8607-4c5a-b706-7cc8dc3327b8-kube-api-access-xkp5h\") pod \"cert-manager-55b4d954d5-cdxcz\" (UID: \"5828448b-8607-4c5a-b706-7cc8dc3327b8\") " pod="cert-manager/cert-manager-55b4d954d5-cdxcz"
Jul 02 23:15:03.966199 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:03.966171    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5828448b-8607-4c5a-b706-7cc8dc3327b8-bound-sa-token\") pod \"cert-manager-55b4d954d5-cdxcz\" (UID: \"5828448b-8607-4c5a-b706-7cc8dc3327b8\") " pod="cert-manager/cert-manager-55b4d954d5-cdxcz"
Jul 02 23:15:03.966372 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:03.966353    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkp5h\" (UniqueName: \"kubernetes.io/projected/5828448b-8607-4c5a-b706-7cc8dc3327b8-kube-api-access-xkp5h\") pod \"cert-manager-55b4d954d5-cdxcz\" (UID: \"5828448b-8607-4c5a-b706-7cc8dc3327b8\") " pod="cert-manager/cert-manager-55b4d954d5-cdxcz"
Jul 02 23:15:04.050268 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:04.050183    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-cdxcz"
Jul 02 23:15:04.174544 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:04.174503    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cdxcz"]
Jul 02 23:15:04.177478 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:15:04.177453    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5828448b_8607_4c5a_b706_7cc8dc3327b8.slice/crio-8334b6ae9e98f35940ad1a4d9eab68305c5cceebf6ca193d7dd4f33a2c85ce12 WatchSource:0}: Error finding container 8334b6ae9e98f35940ad1a4d9eab68305c5cceebf6ca193d7dd4f33a2c85ce12: Status 404 returned error can't find the container with id 8334b6ae9e98f35940ad1a4d9eab68305c5cceebf6ca193d7dd4f33a2c85ce12
Jul 02 23:15:05.171764 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:05.171726    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-cdxcz" event={"ID":"5828448b-8607-4c5a-b706-7cc8dc3327b8","Type":"ContainerStarted","Data":"8334b6ae9e98f35940ad1a4d9eab68305c5cceebf6ca193d7dd4f33a2c85ce12"}
Jul 02 23:15:09.190223 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:09.190189    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-cdxcz" event={"ID":"5828448b-8607-4c5a-b706-7cc8dc3327b8","Type":"ContainerStarted","Data":"6d4d0a05a3921b5d52656d46114b99b0578a7576553843869a8fc39af37ae87c"}
Jul 02 23:15:09.208123 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:09.208068    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-cdxcz" podStartSLOduration=1.353603617 podStartE2EDuration="6.208052817s" totalImagesPullingTime="4.8544492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:09.207017288 +0000 UTC m=+257.831435665" watchObservedRunningTime="2026-07-02 23:15:09.208052817 +0000 UTC m=+257.832471193"
Jul 02 23:15:15.248579 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:15.248498    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5wxmc"]
Jul 02 23:15:15.251296 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:15.251279    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5wxmc"
Jul 02 23:15:15.255322 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:15.255299    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 23:15:15.255458 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:15.255354    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-s72lz\""
Jul 02 23:15:15.255458 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:15.255400    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:15:15.261681 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:15.261661    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5wxmc"]
Jul 02 23:15:15.339871 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:15.339835    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8affe14-1235-4476-8610-99215a412d82-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5wxmc\" (UID: \"f8affe14-1235-4476-8610-99215a412d82\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5wxmc"
Jul 02 23:15:15.340084 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:15.339885    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn9q2\" (UniqueName: \"kubernetes.io/projected/f8affe14-1235-4476-8610-99215a412d82-kube-api-access-fn9q2\") pod \"openshift-lws-operator-fd8ccff4c-5wxmc\" (UID: \"f8affe14-1235-4476-8610-99215a412d82\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5wxmc"
Jul 02 23:15:15.441136 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:15.441099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8affe14-1235-4476-8610-99215a412d82-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5wxmc\" (UID: \"f8affe14-1235-4476-8610-99215a412d82\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5wxmc"
Jul 02 23:15:15.441325 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:15.441177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn9q2\" (UniqueName: \"kubernetes.io/projected/f8affe14-1235-4476-8610-99215a412d82-kube-api-access-fn9q2\") pod \"openshift-lws-operator-fd8ccff4c-5wxmc\" (UID: \"f8affe14-1235-4476-8610-99215a412d82\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5wxmc"
Jul 02 23:15:15.441482 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:15.441463    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8affe14-1235-4476-8610-99215a412d82-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5wxmc\" (UID: \"f8affe14-1235-4476-8610-99215a412d82\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5wxmc"
Jul 02 23:15:15.450469 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:15.450448    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn9q2\" (UniqueName: \"kubernetes.io/projected/f8affe14-1235-4476-8610-99215a412d82-kube-api-access-fn9q2\") pod \"openshift-lws-operator-fd8ccff4c-5wxmc\" (UID: \"f8affe14-1235-4476-8610-99215a412d82\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5wxmc"
Jul 02 23:15:15.559829 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:15.559739    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5wxmc"
Jul 02 23:15:15.700940 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:15.700896    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5wxmc"]
Jul 02 23:15:15.703337 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:15:15.703310    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8affe14_1235_4476_8610_99215a412d82.slice/crio-cbb45d2f3003ff0b31456a175230cc5f03d0593208bb916f0b80c59a54b6863b WatchSource:0}: Error finding container cbb45d2f3003ff0b31456a175230cc5f03d0593208bb916f0b80c59a54b6863b: Status 404 returned error can't find the container with id cbb45d2f3003ff0b31456a175230cc5f03d0593208bb916f0b80c59a54b6863b
Jul 02 23:15:16.219396 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:16.219362    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5wxmc" event={"ID":"f8affe14-1235-4476-8610-99215a412d82","Type":"ContainerStarted","Data":"cbb45d2f3003ff0b31456a175230cc5f03d0593208bb916f0b80c59a54b6863b"}
Jul 02 23:15:18.229565 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:18.229523    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5wxmc" event={"ID":"f8affe14-1235-4476-8610-99215a412d82","Type":"ContainerStarted","Data":"549043addbd6d596064084bec336bcac32d94ff47b1c2adbe7dc2df029a3fb60"}
Jul 02 23:15:18.247415 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:18.247309    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5wxmc" podStartSLOduration=0.900119928 podStartE2EDuration="3.247291671s" totalImagesPullingTime="2.347171743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:18.246188083 +0000 UTC m=+266.870606484" watchObservedRunningTime="2026-07-02 23:15:18.247291671 +0000 UTC m=+266.871710053"
Jul 02 23:15:21.098835 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.098786    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"]
Jul 02 23:15:21.102295 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.102279    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"
Jul 02 23:15:21.105029 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.105009    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 02 23:15:21.105140 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.105030    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wdwfr\""
Jul 02 23:15:21.105140 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.105051    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 02 23:15:21.110422 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.110400    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"]
Jul 02 23:15:21.191389 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.191362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46e82e68-af57-4173-a4ae-ce330fdecd30-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j\" (UID: \"46e82e68-af57-4173-a4ae-ce330fdecd30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"
Jul 02 23:15:21.191546 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.191398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9pwp\" (UniqueName: \"kubernetes.io/projected/46e82e68-af57-4173-a4ae-ce330fdecd30-kube-api-access-q9pwp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j\" (UID: \"46e82e68-af57-4173-a4ae-ce330fdecd30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"
Jul 02 23:15:21.191546 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.191501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46e82e68-af57-4173-a4ae-ce330fdecd30-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j\" (UID: \"46e82e68-af57-4173-a4ae-ce330fdecd30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"
Jul 02 23:15:21.292926 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.292885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46e82e68-af57-4173-a4ae-ce330fdecd30-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j\" (UID: \"46e82e68-af57-4173-a4ae-ce330fdecd30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"
Jul 02 23:15:21.293100 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.293030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9pwp\" (UniqueName: \"kubernetes.io/projected/46e82e68-af57-4173-a4ae-ce330fdecd30-kube-api-access-q9pwp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j\" (UID: \"46e82e68-af57-4173-a4ae-ce330fdecd30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"
Jul 02 23:15:21.293100 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.293074    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46e82e68-af57-4173-a4ae-ce330fdecd30-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j\" (UID: \"46e82e68-af57-4173-a4ae-ce330fdecd30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"
Jul 02 23:15:21.293295 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.293276    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46e82e68-af57-4173-a4ae-ce330fdecd30-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j\" (UID: \"46e82e68-af57-4173-a4ae-ce330fdecd30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"
Jul 02 23:15:21.293331 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.293319    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46e82e68-af57-4173-a4ae-ce330fdecd30-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j\" (UID: \"46e82e68-af57-4173-a4ae-ce330fdecd30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"
Jul 02 23:15:21.302201 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.302181    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9pwp\" (UniqueName: \"kubernetes.io/projected/46e82e68-af57-4173-a4ae-ce330fdecd30-kube-api-access-q9pwp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j\" (UID: \"46e82e68-af57-4173-a4ae-ce330fdecd30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"
Jul 02 23:15:21.411975 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.411885    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"
Jul 02 23:15:21.540850 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:21.540815    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"]
Jul 02 23:15:21.543623 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:15:21.543587    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46e82e68_af57_4173_a4ae_ce330fdecd30.slice/crio-ef8f2ce85a7a35bdee597847d0b77dbeeca0bf6390e34a18417c27abde02e986 WatchSource:0}: Error finding container ef8f2ce85a7a35bdee597847d0b77dbeeca0bf6390e34a18417c27abde02e986: Status 404 returned error can't find the container with id ef8f2ce85a7a35bdee597847d0b77dbeeca0bf6390e34a18417c27abde02e986
Jul 02 23:15:22.248012 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:22.247974    2563 generic.go:356] "Generic (PLEG): container finished" podID="46e82e68-af57-4173-a4ae-ce330fdecd30" containerID="a093d9841e5013092369cdea705ffc8014d31204cbc88fd5edaaed935daf3693" exitCode=0
Jul 02 23:15:22.248409 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:22.248059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j" event={"ID":"46e82e68-af57-4173-a4ae-ce330fdecd30","Type":"ContainerDied","Data":"a093d9841e5013092369cdea705ffc8014d31204cbc88fd5edaaed935daf3693"}
Jul 02 23:15:22.248409 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:22.248120    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j" event={"ID":"46e82e68-af57-4173-a4ae-ce330fdecd30","Type":"ContainerStarted","Data":"ef8f2ce85a7a35bdee597847d0b77dbeeca0bf6390e34a18417c27abde02e986"}
Jul 02 23:15:23.254550 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:23.254517    2563 generic.go:356] "Generic (PLEG): container finished" podID="46e82e68-af57-4173-a4ae-ce330fdecd30" containerID="235ade243fd32af6c911e20a6da7eddb66c06cefe1cdd4491013bce470eac7a7" exitCode=0
Jul 02 23:15:23.254980 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:23.254607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j" event={"ID":"46e82e68-af57-4173-a4ae-ce330fdecd30","Type":"ContainerDied","Data":"235ade243fd32af6c911e20a6da7eddb66c06cefe1cdd4491013bce470eac7a7"}
Jul 02 23:15:24.260600 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:24.260563    2563 generic.go:356] "Generic (PLEG): container finished" podID="46e82e68-af57-4173-a4ae-ce330fdecd30" containerID="0dc2a3f81fc99bf0723009fff01b8cd7294cf7a34f8ed33c7a934a53e415e6b2" exitCode=0
Jul 02 23:15:24.260983 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:24.260639    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j" event={"ID":"46e82e68-af57-4173-a4ae-ce330fdecd30","Type":"ContainerDied","Data":"0dc2a3f81fc99bf0723009fff01b8cd7294cf7a34f8ed33c7a934a53e415e6b2"}
Jul 02 23:15:25.391897 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:25.391875    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"
Jul 02 23:15:25.423116 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:25.423086    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46e82e68-af57-4173-a4ae-ce330fdecd30-util\") pod \"46e82e68-af57-4173-a4ae-ce330fdecd30\" (UID: \"46e82e68-af57-4173-a4ae-ce330fdecd30\") "
Jul 02 23:15:25.423242 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:25.423129    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46e82e68-af57-4173-a4ae-ce330fdecd30-bundle\") pod \"46e82e68-af57-4173-a4ae-ce330fdecd30\" (UID: \"46e82e68-af57-4173-a4ae-ce330fdecd30\") "
Jul 02 23:15:25.423242 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:25.423160    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9pwp\" (UniqueName: \"kubernetes.io/projected/46e82e68-af57-4173-a4ae-ce330fdecd30-kube-api-access-q9pwp\") pod \"46e82e68-af57-4173-a4ae-ce330fdecd30\" (UID: \"46e82e68-af57-4173-a4ae-ce330fdecd30\") "
Jul 02 23:15:25.423859 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:25.423822    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46e82e68-af57-4173-a4ae-ce330fdecd30-bundle" (OuterVolumeSpecName: "bundle") pod "46e82e68-af57-4173-a4ae-ce330fdecd30" (UID: "46e82e68-af57-4173-a4ae-ce330fdecd30"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:15:25.425307 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:25.425288    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46e82e68-af57-4173-a4ae-ce330fdecd30-kube-api-access-q9pwp" (OuterVolumeSpecName: "kube-api-access-q9pwp") pod "46e82e68-af57-4173-a4ae-ce330fdecd30" (UID: "46e82e68-af57-4173-a4ae-ce330fdecd30"). InnerVolumeSpecName "kube-api-access-q9pwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:15:25.431300 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:25.431261    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46e82e68-af57-4173-a4ae-ce330fdecd30-util" (OuterVolumeSpecName: "util") pod "46e82e68-af57-4173-a4ae-ce330fdecd30" (UID: "46e82e68-af57-4173-a4ae-ce330fdecd30"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:15:25.524415 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:25.524360    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46e82e68-af57-4173-a4ae-ce330fdecd30-util\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:15:25.524415 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:25.524382    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46e82e68-af57-4173-a4ae-ce330fdecd30-bundle\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:15:25.524415 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:25.524391    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9pwp\" (UniqueName: \"kubernetes.io/projected/46e82e68-af57-4173-a4ae-ce330fdecd30-kube-api-access-q9pwp\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:15:26.270591 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:26.270522    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j"
Jul 02 23:15:26.270726 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:26.270521    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afq887j" event={"ID":"46e82e68-af57-4173-a4ae-ce330fdecd30","Type":"ContainerDied","Data":"ef8f2ce85a7a35bdee597847d0b77dbeeca0bf6390e34a18417c27abde02e986"}
Jul 02 23:15:26.270726 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:26.270651    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef8f2ce85a7a35bdee597847d0b77dbeeca0bf6390e34a18417c27abde02e986"
Jul 02 23:15:35.118480 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.118448    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"]
Jul 02 23:15:35.118874 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.118752    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46e82e68-af57-4173-a4ae-ce330fdecd30" containerName="extract"
Jul 02 23:15:35.118874 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.118762    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="46e82e68-af57-4173-a4ae-ce330fdecd30" containerName="extract"
Jul 02 23:15:35.118874 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.118774    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46e82e68-af57-4173-a4ae-ce330fdecd30" containerName="pull"
Jul 02 23:15:35.118874 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.118779    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="46e82e68-af57-4173-a4ae-ce330fdecd30" containerName="pull"
Jul 02 23:15:35.118874 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.118794    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46e82e68-af57-4173-a4ae-ce330fdecd30" containerName="util"
Jul 02 23:15:35.118874 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.118799    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="46e82e68-af57-4173-a4ae-ce330fdecd30" containerName="util"
Jul 02 23:15:35.118874 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.118861    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="46e82e68-af57-4173-a4ae-ce330fdecd30" containerName="extract"
Jul 02 23:15:35.123255 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.123237    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.126412 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.126392    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 23:15:35.126722 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.126703    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 23:15:35.126949 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.126931    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 23:15:35.127034 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.126950    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kfpkl\""
Jul 02 23:15:35.127240 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.127227    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 23:15:35.153182 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.153162    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"]
Jul 02 23:15:35.198037 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.198009    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-xs7ck\" (UID: \"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.198139 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.198047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc-tmp\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-xs7ck\" (UID: \"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.198139 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.198072    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r8t2\" (UniqueName: \"kubernetes.io/projected/6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc-kube-api-access-8r8t2\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-xs7ck\" (UID: \"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.198212 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.198135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc-manifests\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-xs7ck\" (UID: \"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.198212 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.198163    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-xs7ck\" (UID: \"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.299472 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.299437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-xs7ck\" (UID: \"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.299606 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.299483    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc-tmp\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-xs7ck\" (UID: \"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.299606 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.299511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r8t2\" (UniqueName: \"kubernetes.io/projected/6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc-kube-api-access-8r8t2\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-xs7ck\" (UID: \"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.299606 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.299534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc-manifests\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-xs7ck\" (UID: \"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.299606 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.299551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-xs7ck\" (UID: \"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.299983 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.299951    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc-manifests\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-xs7ck\" (UID: \"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.301741 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.301714    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc-tmp\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-xs7ck\" (UID: \"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.301874 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.301855    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-xs7ck\" (UID: \"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.302007 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.301990    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-xs7ck\" (UID: \"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.369442 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.369377    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r8t2\" (UniqueName: \"kubernetes.io/projected/6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc-kube-api-access-8r8t2\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-xs7ck\" (UID: \"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.433501 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.433470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:35.596149 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:35.596126    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"]
Jul 02 23:15:35.598770 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:15:35.598745    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cabd2e9_c3e3_4bec_8d0f_eb7c5d407dcc.slice/crio-58c3baa89ecc2f6a5ba0fc5a62ba57eabbba20378555c83406efcacbea5d7902 WatchSource:0}: Error finding container 58c3baa89ecc2f6a5ba0fc5a62ba57eabbba20378555c83406efcacbea5d7902: Status 404 returned error can't find the container with id 58c3baa89ecc2f6a5ba0fc5a62ba57eabbba20378555c83406efcacbea5d7902
Jul 02 23:15:36.315625 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:36.315580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck" event={"ID":"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc","Type":"ContainerStarted","Data":"58c3baa89ecc2f6a5ba0fc5a62ba57eabbba20378555c83406efcacbea5d7902"}
Jul 02 23:15:39.330185 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:39.330141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck" event={"ID":"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc","Type":"ContainerStarted","Data":"06cc4fd7c386a253525c16d57b725eb12c8488d13c6ea0feecf89b68b4ad7836"}
Jul 02 23:15:40.336751 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:40.336717    2563 generic.go:356] "Generic (PLEG): container finished" podID="6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc" containerID="06cc4fd7c386a253525c16d57b725eb12c8488d13c6ea0feecf89b68b4ad7836" exitCode=0
Jul 02 23:15:40.337215 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:40.336769    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck" event={"ID":"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc","Type":"ContainerDied","Data":"06cc4fd7c386a253525c16d57b725eb12c8488d13c6ea0feecf89b68b4ad7836"}
Jul 02 23:15:41.342628 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:41.342597    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck" event={"ID":"6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc","Type":"ContainerStarted","Data":"702bd86cc1e6349bd4154a8f39afd8b5176faf542c2bdecb2d38f128c4582c19"}
Jul 02 23:15:41.343050 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:41.342702    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:41.380394 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:41.380340    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck" podStartSLOduration=2.233077711 podStartE2EDuration="6.380325275s" totalImagesPullingTime="3.072646369s" totalInitContainerRuntime="1.074601195s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:41.378021139 +0000 UTC m=+290.002439515" watchObservedRunningTime="2026-07-02 23:15:41.380325275 +0000 UTC m=+290.004743650"
Jul 02 23:15:51.753935 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:51.753891    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:15:51.766544 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:51.766521    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 23:15:51.776302 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:51.776275    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:15:52.348512 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:52.348482    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-xs7ck"
Jul 02 23:15:55.424519 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.424485    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b76b84765-84r9v"]
Jul 02 23:15:55.427750 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.427735    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b76b84765-84r9v"
Jul 02 23:15:55.432248 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.432218    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 23:15:55.432527 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.432510    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 23:15:55.432637 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.432577    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jhstc\""
Jul 02 23:15:55.497226 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.497193    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b76b84765-84r9v"]
Jul 02 23:15:55.571500 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.571470    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c13fecf7-9389-446d-b7ae-4976d04ed486-tmp\") pod \"kube-auth-proxy-5b76b84765-84r9v\" (UID: \"c13fecf7-9389-446d-b7ae-4976d04ed486\") " pod="openshift-ingress/kube-auth-proxy-5b76b84765-84r9v"
Jul 02 23:15:55.571500 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.571503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c13fecf7-9389-446d-b7ae-4976d04ed486-tls-certs\") pod \"kube-auth-proxy-5b76b84765-84r9v\" (UID: \"c13fecf7-9389-446d-b7ae-4976d04ed486\") " pod="openshift-ingress/kube-auth-proxy-5b76b84765-84r9v"
Jul 02 23:15:55.571682 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.571531    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd4c5\" (UniqueName: \"kubernetes.io/projected/c13fecf7-9389-446d-b7ae-4976d04ed486-kube-api-access-kd4c5\") pod \"kube-auth-proxy-5b76b84765-84r9v\" (UID: \"c13fecf7-9389-446d-b7ae-4976d04ed486\") " pod="openshift-ingress/kube-auth-proxy-5b76b84765-84r9v"
Jul 02 23:15:55.672886 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.672853    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c13fecf7-9389-446d-b7ae-4976d04ed486-tmp\") pod \"kube-auth-proxy-5b76b84765-84r9v\" (UID: \"c13fecf7-9389-446d-b7ae-4976d04ed486\") " pod="openshift-ingress/kube-auth-proxy-5b76b84765-84r9v"
Jul 02 23:15:55.673053 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.672892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c13fecf7-9389-446d-b7ae-4976d04ed486-tls-certs\") pod \"kube-auth-proxy-5b76b84765-84r9v\" (UID: \"c13fecf7-9389-446d-b7ae-4976d04ed486\") " pod="openshift-ingress/kube-auth-proxy-5b76b84765-84r9v"
Jul 02 23:15:55.673053 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.672926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd4c5\" (UniqueName: \"kubernetes.io/projected/c13fecf7-9389-446d-b7ae-4976d04ed486-kube-api-access-kd4c5\") pod \"kube-auth-proxy-5b76b84765-84r9v\" (UID: \"c13fecf7-9389-446d-b7ae-4976d04ed486\") " pod="openshift-ingress/kube-auth-proxy-5b76b84765-84r9v"
Jul 02 23:15:55.675133 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.675085    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c13fecf7-9389-446d-b7ae-4976d04ed486-tmp\") pod \"kube-auth-proxy-5b76b84765-84r9v\" (UID: \"c13fecf7-9389-446d-b7ae-4976d04ed486\") " pod="openshift-ingress/kube-auth-proxy-5b76b84765-84r9v"
Jul 02 23:15:55.675322 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.675304    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c13fecf7-9389-446d-b7ae-4976d04ed486-tls-certs\") pod \"kube-auth-proxy-5b76b84765-84r9v\" (UID: \"c13fecf7-9389-446d-b7ae-4976d04ed486\") " pod="openshift-ingress/kube-auth-proxy-5b76b84765-84r9v"
Jul 02 23:15:55.727264 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.727229    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd4c5\" (UniqueName: \"kubernetes.io/projected/c13fecf7-9389-446d-b7ae-4976d04ed486-kube-api-access-kd4c5\") pod \"kube-auth-proxy-5b76b84765-84r9v\" (UID: \"c13fecf7-9389-446d-b7ae-4976d04ed486\") " pod="openshift-ingress/kube-auth-proxy-5b76b84765-84r9v"
Jul 02 23:15:55.738036 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.738014    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b76b84765-84r9v"
Jul 02 23:15:55.913329 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.913210    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b76b84765-84r9v"]
Jul 02 23:15:55.915841 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:15:55.915816    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc13fecf7_9389_446d_b7ae_4976d04ed486.slice/crio-37e2efae4f86fd5958e2ceab69ee9411e105099ac1de502bc3df3f308c92595b WatchSource:0}: Error finding container 37e2efae4f86fd5958e2ceab69ee9411e105099ac1de502bc3df3f308c92595b: Status 404 returned error can't find the container with id 37e2efae4f86fd5958e2ceab69ee9411e105099ac1de502bc3df3f308c92595b
Jul 02 23:15:55.917550 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:55.917534    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:15:56.409891 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:56.409852    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b76b84765-84r9v" event={"ID":"c13fecf7-9389-446d-b7ae-4976d04ed486","Type":"ContainerStarted","Data":"37e2efae4f86fd5958e2ceab69ee9411e105099ac1de502bc3df3f308c92595b"}
Jul 02 23:15:57.488302 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:57.488268    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dtgnj"]
Jul 02 23:15:57.491653 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:57.491636    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dtgnj"
Jul 02 23:15:57.499033 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:57.499011    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 02 23:15:57.522027 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:57.522003    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dtgnj"]
Jul 02 23:15:57.590156 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:57.590130    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fqpd\" (UniqueName: \"kubernetes.io/projected/9ed53ccc-181f-49ca-9a06-786b75d0b9c2-kube-api-access-2fqpd\") pod \"model-serving-api-54d89bd5fc-dtgnj\" (UID: \"9ed53ccc-181f-49ca-9a06-786b75d0b9c2\") " pod="opendatahub/model-serving-api-54d89bd5fc-dtgnj"
Jul 02 23:15:57.590321 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:57.590182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ed53ccc-181f-49ca-9a06-786b75d0b9c2-tls-certs\") pod \"model-serving-api-54d89bd5fc-dtgnj\" (UID: \"9ed53ccc-181f-49ca-9a06-786b75d0b9c2\") " pod="opendatahub/model-serving-api-54d89bd5fc-dtgnj"
Jul 02 23:15:57.691490 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:57.691462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ed53ccc-181f-49ca-9a06-786b75d0b9c2-tls-certs\") pod \"model-serving-api-54d89bd5fc-dtgnj\" (UID: \"9ed53ccc-181f-49ca-9a06-786b75d0b9c2\") " pod="opendatahub/model-serving-api-54d89bd5fc-dtgnj"
Jul 02 23:15:57.691619 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:15:57.691603    2563 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 02 23:15:57.691673 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:57.691618    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fqpd\" (UniqueName: \"kubernetes.io/projected/9ed53ccc-181f-49ca-9a06-786b75d0b9c2-kube-api-access-2fqpd\") pod \"model-serving-api-54d89bd5fc-dtgnj\" (UID: \"9ed53ccc-181f-49ca-9a06-786b75d0b9c2\") " pod="opendatahub/model-serving-api-54d89bd5fc-dtgnj"
Jul 02 23:15:57.691673 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:15:57.691661    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ed53ccc-181f-49ca-9a06-786b75d0b9c2-tls-certs podName:9ed53ccc-181f-49ca-9a06-786b75d0b9c2 nodeName:}" failed. No retries permitted until 2026-07-02 23:15:58.19164426 +0000 UTC m=+306.816062615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9ed53ccc-181f-49ca-9a06-786b75d0b9c2-tls-certs") pod "model-serving-api-54d89bd5fc-dtgnj" (UID: "9ed53ccc-181f-49ca-9a06-786b75d0b9c2") : secret "model-serving-api-tls" not found
Jul 02 23:15:57.710381 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:57.710355    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fqpd\" (UniqueName: \"kubernetes.io/projected/9ed53ccc-181f-49ca-9a06-786b75d0b9c2-kube-api-access-2fqpd\") pod \"model-serving-api-54d89bd5fc-dtgnj\" (UID: \"9ed53ccc-181f-49ca-9a06-786b75d0b9c2\") " pod="opendatahub/model-serving-api-54d89bd5fc-dtgnj"
Jul 02 23:15:58.196198 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:58.196162    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ed53ccc-181f-49ca-9a06-786b75d0b9c2-tls-certs\") pod \"model-serving-api-54d89bd5fc-dtgnj\" (UID: \"9ed53ccc-181f-49ca-9a06-786b75d0b9c2\") " pod="opendatahub/model-serving-api-54d89bd5fc-dtgnj"
Jul 02 23:15:58.196380 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:15:58.196333    2563 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 02 23:15:58.196449 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:15:58.196403    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ed53ccc-181f-49ca-9a06-786b75d0b9c2-tls-certs podName:9ed53ccc-181f-49ca-9a06-786b75d0b9c2 nodeName:}" failed. No retries permitted until 2026-07-02 23:15:59.196381635 +0000 UTC m=+307.820799989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9ed53ccc-181f-49ca-9a06-786b75d0b9c2-tls-certs") pod "model-serving-api-54d89bd5fc-dtgnj" (UID: "9ed53ccc-181f-49ca-9a06-786b75d0b9c2") : secret "model-serving-api-tls" not found
Jul 02 23:15:59.205992 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:59.205957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ed53ccc-181f-49ca-9a06-786b75d0b9c2-tls-certs\") pod \"model-serving-api-54d89bd5fc-dtgnj\" (UID: \"9ed53ccc-181f-49ca-9a06-786b75d0b9c2\") " pod="opendatahub/model-serving-api-54d89bd5fc-dtgnj"
Jul 02 23:15:59.208310 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:59.208283    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ed53ccc-181f-49ca-9a06-786b75d0b9c2-tls-certs\") pod \"model-serving-api-54d89bd5fc-dtgnj\" (UID: \"9ed53ccc-181f-49ca-9a06-786b75d0b9c2\") " pod="opendatahub/model-serving-api-54d89bd5fc-dtgnj"
Jul 02 23:15:59.303194 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:59.303172    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-dtgnj"
Jul 02 23:15:59.425533 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:59.425505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b76b84765-84r9v" event={"ID":"c13fecf7-9389-446d-b7ae-4976d04ed486","Type":"ContainerStarted","Data":"9c0dea6753094c1d0c93d5f8a40d787a0b7decc3991ce25e556c08099ab9c30a"}
Jul 02 23:15:59.429757 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:59.429737    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-dtgnj"]
Jul 02 23:15:59.431609 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:15:59.431573    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed53ccc_181f_49ca_9a06_786b75d0b9c2.slice/crio-a2d78d29bfdf42612dc8fff5accf25a8e270e653a3eb495801b0b0da97a42a50 WatchSource:0}: Error finding container a2d78d29bfdf42612dc8fff5accf25a8e270e653a3eb495801b0b0da97a42a50: Status 404 returned error can't find the container with id a2d78d29bfdf42612dc8fff5accf25a8e270e653a3eb495801b0b0da97a42a50
Jul 02 23:15:59.443974 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:15:59.443912    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b76b84765-84r9v" podStartSLOduration=1.847076771 podStartE2EDuration="4.443897536s" totalImagesPullingTime="2.596820765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:59.442711405 +0000 UTC m=+308.067129782" watchObservedRunningTime="2026-07-02 23:15:59.443897536 +0000 UTC m=+308.068315912"
Jul 02 23:16:00.431880 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:00.431837    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dtgnj" event={"ID":"9ed53ccc-181f-49ca-9a06-786b75d0b9c2","Type":"ContainerStarted","Data":"a2d78d29bfdf42612dc8fff5accf25a8e270e653a3eb495801b0b0da97a42a50"}
Jul 02 23:16:01.126831 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.126796    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"]
Jul 02 23:16:01.130101 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.130079    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:16:01.133805 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.133780    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 23:16:01.133805 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.133796    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 23:16:01.134007 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.133830    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 23:16:01.134007 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.133832    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ljqph\""
Jul 02 23:16:01.139426 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.139406    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"]
Jul 02 23:16:01.220086 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.220045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fa373d68-7029-4639-a58e-d510a14bd1c9-manager-config\") pod \"lws-controller-manager-747bc6df4d-hr28b\" (UID: \"fa373d68-7029-4639-a58e-d510a14bd1c9\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:16:01.220239 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.220108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa373d68-7029-4639-a58e-d510a14bd1c9-cert\") pod \"lws-controller-manager-747bc6df4d-hr28b\" (UID: \"fa373d68-7029-4639-a58e-d510a14bd1c9\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:16:01.220239 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.220132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa373d68-7029-4639-a58e-d510a14bd1c9-metrics-cert\") pod \"lws-controller-manager-747bc6df4d-hr28b\" (UID: \"fa373d68-7029-4639-a58e-d510a14bd1c9\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:16:01.220239 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.220159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2rq7\" (UniqueName: \"kubernetes.io/projected/fa373d68-7029-4639-a58e-d510a14bd1c9-kube-api-access-s2rq7\") pod \"lws-controller-manager-747bc6df4d-hr28b\" (UID: \"fa373d68-7029-4639-a58e-d510a14bd1c9\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:16:01.320987 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.320958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa373d68-7029-4639-a58e-d510a14bd1c9-cert\") pod \"lws-controller-manager-747bc6df4d-hr28b\" (UID: \"fa373d68-7029-4639-a58e-d510a14bd1c9\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:16:01.320987 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.320988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa373d68-7029-4639-a58e-d510a14bd1c9-metrics-cert\") pod \"lws-controller-manager-747bc6df4d-hr28b\" (UID: \"fa373d68-7029-4639-a58e-d510a14bd1c9\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:16:01.321153 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.321017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2rq7\" (UniqueName: \"kubernetes.io/projected/fa373d68-7029-4639-a58e-d510a14bd1c9-kube-api-access-s2rq7\") pod \"lws-controller-manager-747bc6df4d-hr28b\" (UID: \"fa373d68-7029-4639-a58e-d510a14bd1c9\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:16:01.321153 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.321058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fa373d68-7029-4639-a58e-d510a14bd1c9-manager-config\") pod \"lws-controller-manager-747bc6df4d-hr28b\" (UID: \"fa373d68-7029-4639-a58e-d510a14bd1c9\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:16:01.321679 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.321656    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fa373d68-7029-4639-a58e-d510a14bd1c9-manager-config\") pod \"lws-controller-manager-747bc6df4d-hr28b\" (UID: \"fa373d68-7029-4639-a58e-d510a14bd1c9\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:16:01.323494 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.323469    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa373d68-7029-4639-a58e-d510a14bd1c9-cert\") pod \"lws-controller-manager-747bc6df4d-hr28b\" (UID: \"fa373d68-7029-4639-a58e-d510a14bd1c9\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:16:01.323683 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.323662    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa373d68-7029-4639-a58e-d510a14bd1c9-metrics-cert\") pod \"lws-controller-manager-747bc6df4d-hr28b\" (UID: \"fa373d68-7029-4639-a58e-d510a14bd1c9\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:16:01.335201 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.335179    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2rq7\" (UniqueName: \"kubernetes.io/projected/fa373d68-7029-4639-a58e-d510a14bd1c9-kube-api-access-s2rq7\") pod \"lws-controller-manager-747bc6df4d-hr28b\" (UID: \"fa373d68-7029-4639-a58e-d510a14bd1c9\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:16:01.438160 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.438076    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-dtgnj" event={"ID":"9ed53ccc-181f-49ca-9a06-786b75d0b9c2","Type":"ContainerStarted","Data":"a96d88c15fa3c4fdb5d8168bf782d26183569ddebaccd6dd9ad1655743b4234e"}
Jul 02 23:16:01.438160 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.438143    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-dtgnj"
Jul 02 23:16:01.439343 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.439327    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:16:01.457179 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.457137    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-dtgnj" podStartSLOduration=3.222813502 podStartE2EDuration="4.457122662s" totalImagesPullingTime="1.23430916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:01.456153897 +0000 UTC m=+310.080572274" watchObservedRunningTime="2026-07-02 23:16:01.457122662 +0000 UTC m=+310.081541038"
Jul 02 23:16:01.568716 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:01.568669    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"]
Jul 02 23:16:01.570866 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:16:01.570840    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa373d68_7029_4639_a58e_d510a14bd1c9.slice/crio-2f3e49798a5eedfe2245d7db4304ed3d2a5c312e6f4705545466363f5f987c0a WatchSource:0}: Error finding container 2f3e49798a5eedfe2245d7db4304ed3d2a5c312e6f4705545466363f5f987c0a: Status 404 returned error can't find the container with id 2f3e49798a5eedfe2245d7db4304ed3d2a5c312e6f4705545466363f5f987c0a
Jul 02 23:16:02.443911 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:02.443875    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b" event={"ID":"fa373d68-7029-4639-a58e-d510a14bd1c9","Type":"ContainerStarted","Data":"2f3e49798a5eedfe2245d7db4304ed3d2a5c312e6f4705545466363f5f987c0a"}
Jul 02 23:16:04.454458 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:04.454408    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b" event={"ID":"fa373d68-7029-4639-a58e-d510a14bd1c9","Type":"ContainerStarted","Data":"681b9a43175dd68cd43c549b80b5ee9b6e3cdc5d041ac0bee9f08d2ea4148e9d"}
Jul 02 23:16:04.454869 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:04.454534    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:16:12.448706 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:12.448674    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-dtgnj"
Jul 02 23:16:12.486146 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:12.486094    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b" podStartSLOduration=9.480061293 podStartE2EDuration="11.486078695s" totalImagesPullingTime="2.006017402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:04.531613267 +0000 UTC m=+313.156031643" watchObservedRunningTime="2026-07-02 23:16:12.486078695 +0000 UTC m=+321.110497127"
Jul 02 23:16:15.461738 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:16:15.461701    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-hr28b"
Jul 02 23:17:36.565837 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.565799    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b7dd5b4d9-rdbf8"]
Jul 02 23:17:36.568044 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.568015    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.585797 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.585765    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b7dd5b4d9-rdbf8"]
Jul 02 23:17:36.662570 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.662541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7fe2462-c745-4769-9a02-7b40acbf13c9-service-ca\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.662570 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.662576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7fe2462-c745-4769-9a02-7b40acbf13c9-trusted-ca-bundle\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.662777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.662604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7fe2462-c745-4769-9a02-7b40acbf13c9-oauth-serving-cert\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.662777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.662699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzgfc\" (UniqueName: \"kubernetes.io/projected/f7fe2462-c745-4769-9a02-7b40acbf13c9-kube-api-access-wzgfc\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.662777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.662746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7fe2462-c745-4769-9a02-7b40acbf13c9-console-serving-cert\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.662877 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.662793    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7fe2462-c745-4769-9a02-7b40acbf13c9-console-config\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.662877 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.662812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7fe2462-c745-4769-9a02-7b40acbf13c9-console-oauth-config\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.763749 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.763716    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7fe2462-c745-4769-9a02-7b40acbf13c9-console-serving-cert\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.763948 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.763761    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7fe2462-c745-4769-9a02-7b40acbf13c9-console-config\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.763948 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.763783    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7fe2462-c745-4769-9a02-7b40acbf13c9-console-oauth-config\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.763948 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.763813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7fe2462-c745-4769-9a02-7b40acbf13c9-service-ca\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.763948 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.763830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7fe2462-c745-4769-9a02-7b40acbf13c9-trusted-ca-bundle\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.763948 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.763846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7fe2462-c745-4769-9a02-7b40acbf13c9-oauth-serving-cert\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.763948 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.763902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzgfc\" (UniqueName: \"kubernetes.io/projected/f7fe2462-c745-4769-9a02-7b40acbf13c9-kube-api-access-wzgfc\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.764636 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.764562    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7fe2462-c745-4769-9a02-7b40acbf13c9-console-config\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.764765 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.764698    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7fe2462-c745-4769-9a02-7b40acbf13c9-oauth-serving-cert\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.764765 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.764706    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7fe2462-c745-4769-9a02-7b40acbf13c9-service-ca\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.764863 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.764781    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7fe2462-c745-4769-9a02-7b40acbf13c9-trusted-ca-bundle\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.766859 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.766831    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7fe2462-c745-4769-9a02-7b40acbf13c9-console-oauth-config\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.766974 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.766935    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7fe2462-c745-4769-9a02-7b40acbf13c9-console-serving-cert\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.779448 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.779424    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzgfc\" (UniqueName: \"kubernetes.io/projected/f7fe2462-c745-4769-9a02-7b40acbf13c9-kube-api-access-wzgfc\") pod \"console-5b7dd5b4d9-rdbf8\" (UID: \"f7fe2462-c745-4769-9a02-7b40acbf13c9\") " pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:36.877021 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:36.876989    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:37.018338 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:37.018308    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b7dd5b4d9-rdbf8"]
Jul 02 23:17:37.020173 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:17:37.020152    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7fe2462_c745_4769_9a02_7b40acbf13c9.slice/crio-210b6fec8b4c8843c0339cfcea31831eccf54733a3d450b961d799ac371fb43e WatchSource:0}: Error finding container 210b6fec8b4c8843c0339cfcea31831eccf54733a3d450b961d799ac371fb43e: Status 404 returned error can't find the container with id 210b6fec8b4c8843c0339cfcea31831eccf54733a3d450b961d799ac371fb43e
Jul 02 23:17:37.874661 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:37.874628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b7dd5b4d9-rdbf8" event={"ID":"f7fe2462-c745-4769-9a02-7b40acbf13c9","Type":"ContainerStarted","Data":"7d71047faa25014807ef89fcdfc7be16e9bdcd4ec5e19f1e0e9b01020d1f226f"}
Jul 02 23:17:37.875049 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:37.874675    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b7dd5b4d9-rdbf8" event={"ID":"f7fe2462-c745-4769-9a02-7b40acbf13c9","Type":"ContainerStarted","Data":"210b6fec8b4c8843c0339cfcea31831eccf54733a3d450b961d799ac371fb43e"}
Jul 02 23:17:37.902480 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:37.902434    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b7dd5b4d9-rdbf8" podStartSLOduration=1.902419485 podStartE2EDuration="1.902419485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:37.900070594 +0000 UTC m=+406.524488971" watchObservedRunningTime="2026-07-02 23:17:37.902419485 +0000 UTC m=+406.526837861"
Jul 02 23:17:46.878141 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:46.878096    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:46.878537 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:46.878168    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:46.883762 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:46.883736    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:46.917727 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:46.917696    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b7dd5b4d9-rdbf8"
Jul 02 23:17:47.100166 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:17:47.100136    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc4f747c5-2sq7r"]
Jul 02 23:18:12.121403 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.121359    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6cc4f747c5-2sq7r" podUID="808050fa-434c-4a6b-9980-dcb41914e2a1" containerName="console" containerID="cri-o://1a93b82bcd627a7b35f878bf825d0fc1d83e6751830fff2cffe4fcbcc69561ab" gracePeriod=15
Jul 02 23:18:12.378860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.378797    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:18:12.461575 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.461538    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-trusted-ca-bundle\") pod \"808050fa-434c-4a6b-9980-dcb41914e2a1\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") "
Jul 02 23:18:12.461758 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.461590    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7bbp\" (UniqueName: \"kubernetes.io/projected/808050fa-434c-4a6b-9980-dcb41914e2a1-kube-api-access-c7bbp\") pod \"808050fa-434c-4a6b-9980-dcb41914e2a1\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") "
Jul 02 23:18:12.461758 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.461637    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/808050fa-434c-4a6b-9980-dcb41914e2a1-console-oauth-config\") pod \"808050fa-434c-4a6b-9980-dcb41914e2a1\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") "
Jul 02 23:18:12.461758 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.461666    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/808050fa-434c-4a6b-9980-dcb41914e2a1-console-serving-cert\") pod \"808050fa-434c-4a6b-9980-dcb41914e2a1\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") "
Jul 02 23:18:12.461758 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.461683    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-oauth-serving-cert\") pod \"808050fa-434c-4a6b-9980-dcb41914e2a1\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") "
Jul 02 23:18:12.461758 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.461720    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-console-config\") pod \"808050fa-434c-4a6b-9980-dcb41914e2a1\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") "
Jul 02 23:18:12.461758 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.461748    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-service-ca\") pod \"808050fa-434c-4a6b-9980-dcb41914e2a1\" (UID: \"808050fa-434c-4a6b-9980-dcb41914e2a1\") "
Jul 02 23:18:12.462071 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.462030    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "808050fa-434c-4a6b-9980-dcb41914e2a1" (UID: "808050fa-434c-4a6b-9980-dcb41914e2a1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:18:12.462255 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.462233    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "808050fa-434c-4a6b-9980-dcb41914e2a1" (UID: "808050fa-434c-4a6b-9980-dcb41914e2a1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:18:12.462349 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.462295    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-service-ca" (OuterVolumeSpecName: "service-ca") pod "808050fa-434c-4a6b-9980-dcb41914e2a1" (UID: "808050fa-434c-4a6b-9980-dcb41914e2a1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:18:12.462349 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.462307    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-console-config" (OuterVolumeSpecName: "console-config") pod "808050fa-434c-4a6b-9980-dcb41914e2a1" (UID: "808050fa-434c-4a6b-9980-dcb41914e2a1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:18:12.463976 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.463939    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/808050fa-434c-4a6b-9980-dcb41914e2a1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "808050fa-434c-4a6b-9980-dcb41914e2a1" (UID: "808050fa-434c-4a6b-9980-dcb41914e2a1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:18:12.464119 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.464095    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/808050fa-434c-4a6b-9980-dcb41914e2a1-kube-api-access-c7bbp" (OuterVolumeSpecName: "kube-api-access-c7bbp") pod "808050fa-434c-4a6b-9980-dcb41914e2a1" (UID: "808050fa-434c-4a6b-9980-dcb41914e2a1"). InnerVolumeSpecName "kube-api-access-c7bbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:18:12.464119 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.464113    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/808050fa-434c-4a6b-9980-dcb41914e2a1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "808050fa-434c-4a6b-9980-dcb41914e2a1" (UID: "808050fa-434c-4a6b-9980-dcb41914e2a1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:18:12.562733 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.562697    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-trusted-ca-bundle\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:18:12.562733 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.562726    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7bbp\" (UniqueName: \"kubernetes.io/projected/808050fa-434c-4a6b-9980-dcb41914e2a1-kube-api-access-c7bbp\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:18:12.562733 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.562736    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/808050fa-434c-4a6b-9980-dcb41914e2a1-console-oauth-config\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:18:12.562999 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.562748    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/808050fa-434c-4a6b-9980-dcb41914e2a1-console-serving-cert\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:18:12.562999 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.562757    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-oauth-serving-cert\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:18:12.562999 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.562765    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-console-config\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:18:12.562999 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:12.562773    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/808050fa-434c-4a6b-9980-dcb41914e2a1-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:18:13.040752 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:13.040717    2563 generic.go:356] "Generic (PLEG): container finished" podID="808050fa-434c-4a6b-9980-dcb41914e2a1" containerID="1a93b82bcd627a7b35f878bf825d0fc1d83e6751830fff2cffe4fcbcc69561ab" exitCode=0
Jul 02 23:18:13.040947 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:13.040779    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc4f747c5-2sq7r"
Jul 02 23:18:13.040947 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:13.040836    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc4f747c5-2sq7r" event={"ID":"808050fa-434c-4a6b-9980-dcb41914e2a1","Type":"ContainerDied","Data":"1a93b82bcd627a7b35f878bf825d0fc1d83e6751830fff2cffe4fcbcc69561ab"}
Jul 02 23:18:13.040947 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:13.040881    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc4f747c5-2sq7r" event={"ID":"808050fa-434c-4a6b-9980-dcb41914e2a1","Type":"ContainerDied","Data":"85fa7c4b061c9a87a8163e07beadc95ae3c9b0e9f720a4b4e44bd0222a5556d7"}
Jul 02 23:18:13.040947 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:13.040901    2563 scope.go:117] "RemoveContainer" containerID="1a93b82bcd627a7b35f878bf825d0fc1d83e6751830fff2cffe4fcbcc69561ab"
Jul 02 23:18:13.050394 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:13.050376    2563 scope.go:117] "RemoveContainer" containerID="1a93b82bcd627a7b35f878bf825d0fc1d83e6751830fff2cffe4fcbcc69561ab"
Jul 02 23:18:13.050695 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:18:13.050674    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a93b82bcd627a7b35f878bf825d0fc1d83e6751830fff2cffe4fcbcc69561ab\": container with ID starting with 1a93b82bcd627a7b35f878bf825d0fc1d83e6751830fff2cffe4fcbcc69561ab not found: ID does not exist" containerID="1a93b82bcd627a7b35f878bf825d0fc1d83e6751830fff2cffe4fcbcc69561ab"
Jul 02 23:18:13.050742 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:13.050704    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a93b82bcd627a7b35f878bf825d0fc1d83e6751830fff2cffe4fcbcc69561ab"} err="failed to get container status \"1a93b82bcd627a7b35f878bf825d0fc1d83e6751830fff2cffe4fcbcc69561ab\": rpc error: code = NotFound desc = could not find container \"1a93b82bcd627a7b35f878bf825d0fc1d83e6751830fff2cffe4fcbcc69561ab\": container with ID starting with 1a93b82bcd627a7b35f878bf825d0fc1d83e6751830fff2cffe4fcbcc69561ab not found: ID does not exist"
Jul 02 23:18:13.069943 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:13.069880    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc4f747c5-2sq7r"]
Jul 02 23:18:13.071478 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:13.071452    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cc4f747c5-2sq7r"]
Jul 02 23:18:13.073926 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:18:13.073891    2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808050fa_434c_4a6b_9980_dcb41914e2a1.slice/crio-85fa7c4b061c9a87a8163e07beadc95ae3c9b0e9f720a4b4e44bd0222a5556d7\": RecentStats: unable to find data in memory cache]"
Jul 02 23:18:13.885505 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:13.885464    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="808050fa-434c-4a6b-9980-dcb41914e2a1" path="/var/lib/kubelet/pods/808050fa-434c-4a6b-9980-dcb41914e2a1/volumes"
Jul 02 23:18:21.034420 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.034387    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-dnrsr"]
Jul 02 23:18:21.034874 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.034751    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="808050fa-434c-4a6b-9980-dcb41914e2a1" containerName="console"
Jul 02 23:18:21.034874 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.034763    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="808050fa-434c-4a6b-9980-dcb41914e2a1" containerName="console"
Jul 02 23:18:21.034874 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.034821    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="808050fa-434c-4a6b-9980-dcb41914e2a1" containerName="console"
Jul 02 23:18:21.036662 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.036645    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dnrsr"
Jul 02 23:18:21.040683 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.040659    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 23:18:21.040842 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.040824    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 23:18:21.041899 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.041882    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vkm6g\""
Jul 02 23:18:21.048347 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.048323    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-dnrsr"]
Jul 02 23:18:21.134156 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.134110    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2cst\" (UniqueName: \"kubernetes.io/projected/d1acd7af-e95e-4583-abea-5dae60ab4805-kube-api-access-j2cst\") pod \"authorino-58cd955675-dnrsr\" (UID: \"d1acd7af-e95e-4583-abea-5dae60ab4805\") " pod="kuadrant-system/authorino-58cd955675-dnrsr"
Jul 02 23:18:21.178891 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.178841    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-bwz94"]
Jul 02 23:18:21.181638 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.181611    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bwz94"
Jul 02 23:18:21.187263 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.187237    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bwz94"]
Jul 02 23:18:21.235331 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.235297    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2cst\" (UniqueName: \"kubernetes.io/projected/d1acd7af-e95e-4583-abea-5dae60ab4805-kube-api-access-j2cst\") pod \"authorino-58cd955675-dnrsr\" (UID: \"d1acd7af-e95e-4583-abea-5dae60ab4805\") " pod="kuadrant-system/authorino-58cd955675-dnrsr"
Jul 02 23:18:21.243467 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.243434    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2cst\" (UniqueName: \"kubernetes.io/projected/d1acd7af-e95e-4583-abea-5dae60ab4805-kube-api-access-j2cst\") pod \"authorino-58cd955675-dnrsr\" (UID: \"d1acd7af-e95e-4583-abea-5dae60ab4805\") " pod="kuadrant-system/authorino-58cd955675-dnrsr"
Jul 02 23:18:21.335911 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.335875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlp6j\" (UniqueName: \"kubernetes.io/projected/ef1f20b4-2aaa-4335-9728-91e2437fc33c-kube-api-access-qlp6j\") pod \"authorino-75d556bd77-bwz94\" (UID: \"ef1f20b4-2aaa-4335-9728-91e2437fc33c\") " pod="kuadrant-system/authorino-75d556bd77-bwz94"
Jul 02 23:18:21.345808 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.345782    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dnrsr"
Jul 02 23:18:21.436793 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.436756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlp6j\" (UniqueName: \"kubernetes.io/projected/ef1f20b4-2aaa-4335-9728-91e2437fc33c-kube-api-access-qlp6j\") pod \"authorino-75d556bd77-bwz94\" (UID: \"ef1f20b4-2aaa-4335-9728-91e2437fc33c\") " pod="kuadrant-system/authorino-75d556bd77-bwz94"
Jul 02 23:18:21.458143 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.458113    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlp6j\" (UniqueName: \"kubernetes.io/projected/ef1f20b4-2aaa-4335-9728-91e2437fc33c-kube-api-access-qlp6j\") pod \"authorino-75d556bd77-bwz94\" (UID: \"ef1f20b4-2aaa-4335-9728-91e2437fc33c\") " pod="kuadrant-system/authorino-75d556bd77-bwz94"
Jul 02 23:18:21.491898 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.491861    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bwz94"
Jul 02 23:18:21.501212 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.501191    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-dnrsr"]
Jul 02 23:18:21.503187 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:18:21.503161    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1acd7af_e95e_4583_abea_5dae60ab4805.slice/crio-300337be1f6c42a33e19a413d98d3bbc9fffa5a6af3ce8b361c27f7c755411ee WatchSource:0}: Error finding container 300337be1f6c42a33e19a413d98d3bbc9fffa5a6af3ce8b361c27f7c755411ee: Status 404 returned error can't find the container with id 300337be1f6c42a33e19a413d98d3bbc9fffa5a6af3ce8b361c27f7c755411ee
Jul 02 23:18:21.626530 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:21.626445    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bwz94"]
Jul 02 23:18:21.629863 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:18:21.629833    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef1f20b4_2aaa_4335_9728_91e2437fc33c.slice/crio-177583da3bd7668cd0fde50fe72b21ac64aa5e0640dfb5d4889290c260d04a47 WatchSource:0}: Error finding container 177583da3bd7668cd0fde50fe72b21ac64aa5e0640dfb5d4889290c260d04a47: Status 404 returned error can't find the container with id 177583da3bd7668cd0fde50fe72b21ac64aa5e0640dfb5d4889290c260d04a47
Jul 02 23:18:22.089884 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:22.089827    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bwz94" event={"ID":"ef1f20b4-2aaa-4335-9728-91e2437fc33c","Type":"ContainerStarted","Data":"177583da3bd7668cd0fde50fe72b21ac64aa5e0640dfb5d4889290c260d04a47"}
Jul 02 23:18:22.091781 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:22.091750    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dnrsr" event={"ID":"d1acd7af-e95e-4583-abea-5dae60ab4805","Type":"ContainerStarted","Data":"300337be1f6c42a33e19a413d98d3bbc9fffa5a6af3ce8b361c27f7c755411ee"}
Jul 02 23:18:25.110326 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:25.110288    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bwz94" event={"ID":"ef1f20b4-2aaa-4335-9728-91e2437fc33c","Type":"ContainerStarted","Data":"3fd1e0a403b48f05efccf8182b678ec33feb6ed00b8c6031f4a68c71884b073e"}
Jul 02 23:18:25.111747 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:25.111714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dnrsr" event={"ID":"d1acd7af-e95e-4583-abea-5dae60ab4805","Type":"ContainerStarted","Data":"92dc36dcb66edc04c83cc1d9c4a50ea3652779186d4b9f20336490c3f7c32e18"}
Jul 02 23:18:25.126615 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:25.126565    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-bwz94" podStartSLOduration=0.85710177 podStartE2EDuration="4.126550896s" totalImagesPullingTime="3.269449126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:18:25.124376877 +0000 UTC m=+453.748795253" watchObservedRunningTime="2026-07-02 23:18:25.126550896 +0000 UTC m=+453.750969272"
Jul 02 23:18:25.140508 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:25.140461    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-dnrsr" podStartSLOduration=0.738632107 podStartE2EDuration="4.140441981s" totalImagesPullingTime="3.401809874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:18:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:18:25.139509008 +0000 UTC m=+453.763927376" watchObservedRunningTime="2026-07-02 23:18:25.140441981 +0000 UTC m=+453.764860358"
Jul 02 23:18:25.160701 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:25.160639    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-dnrsr"]
Jul 02 23:18:27.120369 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:27.120323    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-dnrsr" podUID="d1acd7af-e95e-4583-abea-5dae60ab4805" containerName="authorino" containerID="cri-o://92dc36dcb66edc04c83cc1d9c4a50ea3652779186d4b9f20336490c3f7c32e18" gracePeriod=30
Jul 02 23:18:27.357867 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:27.357845    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dnrsr"
Jul 02 23:18:27.491174 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:27.491095    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2cst\" (UniqueName: \"kubernetes.io/projected/d1acd7af-e95e-4583-abea-5dae60ab4805-kube-api-access-j2cst\") pod \"d1acd7af-e95e-4583-abea-5dae60ab4805\" (UID: \"d1acd7af-e95e-4583-abea-5dae60ab4805\") "
Jul 02 23:18:27.493320 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:27.493282    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1acd7af-e95e-4583-abea-5dae60ab4805-kube-api-access-j2cst" (OuterVolumeSpecName: "kube-api-access-j2cst") pod "d1acd7af-e95e-4583-abea-5dae60ab4805" (UID: "d1acd7af-e95e-4583-abea-5dae60ab4805"). InnerVolumeSpecName "kube-api-access-j2cst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:18:27.591931 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:27.591883    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2cst\" (UniqueName: \"kubernetes.io/projected/d1acd7af-e95e-4583-abea-5dae60ab4805-kube-api-access-j2cst\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:18:28.125852 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:28.125817    2563 generic.go:356] "Generic (PLEG): container finished" podID="d1acd7af-e95e-4583-abea-5dae60ab4805" containerID="92dc36dcb66edc04c83cc1d9c4a50ea3652779186d4b9f20336490c3f7c32e18" exitCode=0
Jul 02 23:18:28.126253 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:28.125860    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-dnrsr"
Jul 02 23:18:28.126253 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:28.125904    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dnrsr" event={"ID":"d1acd7af-e95e-4583-abea-5dae60ab4805","Type":"ContainerDied","Data":"92dc36dcb66edc04c83cc1d9c4a50ea3652779186d4b9f20336490c3f7c32e18"}
Jul 02 23:18:28.126253 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:28.125960    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-dnrsr" event={"ID":"d1acd7af-e95e-4583-abea-5dae60ab4805","Type":"ContainerDied","Data":"300337be1f6c42a33e19a413d98d3bbc9fffa5a6af3ce8b361c27f7c755411ee"}
Jul 02 23:18:28.126253 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:28.125978    2563 scope.go:117] "RemoveContainer" containerID="92dc36dcb66edc04c83cc1d9c4a50ea3652779186d4b9f20336490c3f7c32e18"
Jul 02 23:18:28.134281 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:28.134265    2563 scope.go:117] "RemoveContainer" containerID="92dc36dcb66edc04c83cc1d9c4a50ea3652779186d4b9f20336490c3f7c32e18"
Jul 02 23:18:28.134529 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:18:28.134512    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92dc36dcb66edc04c83cc1d9c4a50ea3652779186d4b9f20336490c3f7c32e18\": container with ID starting with 92dc36dcb66edc04c83cc1d9c4a50ea3652779186d4b9f20336490c3f7c32e18 not found: ID does not exist" containerID="92dc36dcb66edc04c83cc1d9c4a50ea3652779186d4b9f20336490c3f7c32e18"
Jul 02 23:18:28.134588 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:28.134539    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92dc36dcb66edc04c83cc1d9c4a50ea3652779186d4b9f20336490c3f7c32e18"} err="failed to get container status \"92dc36dcb66edc04c83cc1d9c4a50ea3652779186d4b9f20336490c3f7c32e18\": rpc error: code = NotFound desc = could not find container \"92dc36dcb66edc04c83cc1d9c4a50ea3652779186d4b9f20336490c3f7c32e18\": container with ID starting with 92dc36dcb66edc04c83cc1d9c4a50ea3652779186d4b9f20336490c3f7c32e18 not found: ID does not exist"
Jul 02 23:18:28.153608 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:28.153558    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-dnrsr"]
Jul 02 23:18:28.162981 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:28.162964    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-dnrsr"]
Jul 02 23:18:29.885557 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:29.885523    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1acd7af-e95e-4583-abea-5dae60ab4805" path="/var/lib/kubelet/pods/d1acd7af-e95e-4583-abea-5dae60ab4805/volumes"
Jul 02 23:18:57.934591 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:57.934552    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w68c2"]
Jul 02 23:18:57.935104 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:57.935031    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1acd7af-e95e-4583-abea-5dae60ab4805" containerName="authorino"
Jul 02 23:18:57.935104 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:57.935053    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1acd7af-e95e-4583-abea-5dae60ab4805" containerName="authorino"
Jul 02 23:18:57.935215 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:57.935143    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1acd7af-e95e-4583-abea-5dae60ab4805" containerName="authorino"
Jul 02 23:18:57.940026 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:57.939995    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w68c2"
Jul 02 23:18:57.943515 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:57.943492    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w68c2"]
Jul 02 23:18:58.028322 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.028296    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6987v\" (UniqueName: \"kubernetes.io/projected/b5074456-b1db-4886-b5af-a9e4f909ab5a-kube-api-access-6987v\") pod \"authorino-5d4b67c446-w68c2\" (UID: \"b5074456-b1db-4886-b5af-a9e4f909ab5a\") " pod="kuadrant-system/authorino-5d4b67c446-w68c2"
Jul 02 23:18:58.128766 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.128737    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6987v\" (UniqueName: \"kubernetes.io/projected/b5074456-b1db-4886-b5af-a9e4f909ab5a-kube-api-access-6987v\") pod \"authorino-5d4b67c446-w68c2\" (UID: \"b5074456-b1db-4886-b5af-a9e4f909ab5a\") " pod="kuadrant-system/authorino-5d4b67c446-w68c2"
Jul 02 23:18:58.137252 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.137220    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6987v\" (UniqueName: \"kubernetes.io/projected/b5074456-b1db-4886-b5af-a9e4f909ab5a-kube-api-access-6987v\") pod \"authorino-5d4b67c446-w68c2\" (UID: \"b5074456-b1db-4886-b5af-a9e4f909ab5a\") " pod="kuadrant-system/authorino-5d4b67c446-w68c2"
Jul 02 23:18:58.181331 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.181310    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w68c2"]
Jul 02 23:18:58.181531 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.181520    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w68c2"
Jul 02 23:18:58.210380 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.210355    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c49bdb8bc-7jjhp"]
Jul 02 23:18:58.214328 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.214306    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c49bdb8bc-7jjhp"
Jul 02 23:18:58.222814 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.222791    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c49bdb8bc-7jjhp"]
Jul 02 23:18:58.294520 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.294494    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c49bdb8bc-7jjhp"]
Jul 02 23:18:58.294760 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:18:58.294740    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-g42jd], unattached volumes=[], failed to process volumes=[kube-api-access-g42jd]: context canceled" pod="kuadrant-system/authorino-6c49bdb8bc-7jjhp" podUID="9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481"
Jul 02 23:18:58.322498 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.322472    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-575d9f5975-wqvzj"]
Jul 02 23:18:58.325690 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.325669    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w68c2"]
Jul 02 23:18:58.325795 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.325758    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575d9f5975-wqvzj"
Jul 02 23:18:58.326384 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:18:58.326359    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5074456_b1db_4886_b5af_a9e4f909ab5a.slice/crio-2ee757b36adf7d22fb92889e9650797d22f110d44c0b483e24cf0eb42bca1ac2 WatchSource:0}: Error finding container 2ee757b36adf7d22fb92889e9650797d22f110d44c0b483e24cf0eb42bca1ac2: Status 404 returned error can't find the container with id 2ee757b36adf7d22fb92889e9650797d22f110d44c0b483e24cf0eb42bca1ac2
Jul 02 23:18:58.328294 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.328276    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 02 23:18:58.330625 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.330606    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g42jd\" (UniqueName: \"kubernetes.io/projected/9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481-kube-api-access-g42jd\") pod \"authorino-6c49bdb8bc-7jjhp\" (UID: \"9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481\") " pod="kuadrant-system/authorino-6c49bdb8bc-7jjhp"
Jul 02 23:18:58.334842 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.334822    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-575d9f5975-wqvzj"]
Jul 02 23:18:58.431195 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.431169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g42jd\" (UniqueName: \"kubernetes.io/projected/9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481-kube-api-access-g42jd\") pod \"authorino-6c49bdb8bc-7jjhp\" (UID: \"9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481\") " pod="kuadrant-system/authorino-6c49bdb8bc-7jjhp"
Jul 02 23:18:58.431303 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.431233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7c97e524-fa9f-492c-b1c7-1e152fa4ae12-tls-cert\") pod \"authorino-575d9f5975-wqvzj\" (UID: \"7c97e524-fa9f-492c-b1c7-1e152fa4ae12\") " pod="kuadrant-system/authorino-575d9f5975-wqvzj"
Jul 02 23:18:58.431303 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.431254    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkwr6\" (UniqueName: \"kubernetes.io/projected/7c97e524-fa9f-492c-b1c7-1e152fa4ae12-kube-api-access-bkwr6\") pod \"authorino-575d9f5975-wqvzj\" (UID: \"7c97e524-fa9f-492c-b1c7-1e152fa4ae12\") " pod="kuadrant-system/authorino-575d9f5975-wqvzj"
Jul 02 23:18:58.439068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.439043    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g42jd\" (UniqueName: \"kubernetes.io/projected/9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481-kube-api-access-g42jd\") pod \"authorino-6c49bdb8bc-7jjhp\" (UID: \"9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481\") " pod="kuadrant-system/authorino-6c49bdb8bc-7jjhp"
Jul 02 23:18:58.532230 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.532164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7c97e524-fa9f-492c-b1c7-1e152fa4ae12-tls-cert\") pod \"authorino-575d9f5975-wqvzj\" (UID: \"7c97e524-fa9f-492c-b1c7-1e152fa4ae12\") " pod="kuadrant-system/authorino-575d9f5975-wqvzj"
Jul 02 23:18:58.532230 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.532196    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkwr6\" (UniqueName: \"kubernetes.io/projected/7c97e524-fa9f-492c-b1c7-1e152fa4ae12-kube-api-access-bkwr6\") pod \"authorino-575d9f5975-wqvzj\" (UID: \"7c97e524-fa9f-492c-b1c7-1e152fa4ae12\") " pod="kuadrant-system/authorino-575d9f5975-wqvzj"
Jul 02 23:18:58.534477 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.534452    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7c97e524-fa9f-492c-b1c7-1e152fa4ae12-tls-cert\") pod \"authorino-575d9f5975-wqvzj\" (UID: \"7c97e524-fa9f-492c-b1c7-1e152fa4ae12\") " pod="kuadrant-system/authorino-575d9f5975-wqvzj"
Jul 02 23:18:58.540900 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.540876    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkwr6\" (UniqueName: \"kubernetes.io/projected/7c97e524-fa9f-492c-b1c7-1e152fa4ae12-kube-api-access-bkwr6\") pod \"authorino-575d9f5975-wqvzj\" (UID: \"7c97e524-fa9f-492c-b1c7-1e152fa4ae12\") " pod="kuadrant-system/authorino-575d9f5975-wqvzj"
Jul 02 23:18:58.642688 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.642665    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575d9f5975-wqvzj"
Jul 02 23:18:58.772210 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:58.772180    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-575d9f5975-wqvzj"]
Jul 02 23:18:58.774720 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:18:58.774699    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c97e524_fa9f_492c_b1c7_1e152fa4ae12.slice/crio-46f8cc402bedf87d5b87e30e4b06e61de6483d5a1f8995271f932d6223f60b22 WatchSource:0}: Error finding container 46f8cc402bedf87d5b87e30e4b06e61de6483d5a1f8995271f932d6223f60b22: Status 404 returned error can't find the container with id 46f8cc402bedf87d5b87e30e4b06e61de6483d5a1f8995271f932d6223f60b22
Jul 02 23:18:59.280788 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:59.280750    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575d9f5975-wqvzj" event={"ID":"7c97e524-fa9f-492c-b1c7-1e152fa4ae12","Type":"ContainerStarted","Data":"46f8cc402bedf87d5b87e30e4b06e61de6483d5a1f8995271f932d6223f60b22"}
Jul 02 23:18:59.282351 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:59.282320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w68c2" event={"ID":"b5074456-b1db-4886-b5af-a9e4f909ab5a","Type":"ContainerStarted","Data":"d20be270740f28cac67c5940092cc622401b72399688a81dc8244d6e86363f43"}
Jul 02 23:18:59.282461 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:59.282348    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-w68c2" podUID="b5074456-b1db-4886-b5af-a9e4f909ab5a" containerName="authorino" containerID="cri-o://d20be270740f28cac67c5940092cc622401b72399688a81dc8244d6e86363f43" gracePeriod=30
Jul 02 23:18:59.282461 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:59.282367    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c49bdb8bc-7jjhp"
Jul 02 23:18:59.282461 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:59.282362    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w68c2" event={"ID":"b5074456-b1db-4886-b5af-a9e4f909ab5a","Type":"ContainerStarted","Data":"2ee757b36adf7d22fb92889e9650797d22f110d44c0b483e24cf0eb42bca1ac2"}
Jul 02 23:18:59.300215 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:59.300178    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-w68c2" podStartSLOduration=1.866928777 podStartE2EDuration="2.300164587s" totalImagesPullingTime="433.23581ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:18:59.298322771 +0000 UTC m=+487.922741149" watchObservedRunningTime="2026-07-02 23:18:59.300164587 +0000 UTC m=+487.924583003"
Jul 02 23:18:59.374335 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:59.374314    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c49bdb8bc-7jjhp"
Jul 02 23:18:59.439038 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:59.439003    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g42jd\" (UniqueName: \"kubernetes.io/projected/9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481-kube-api-access-g42jd\") pod \"9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481\" (UID: \"9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481\") "
Jul 02 23:18:59.441397 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:59.441373    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481-kube-api-access-g42jd" (OuterVolumeSpecName: "kube-api-access-g42jd") pod "9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481" (UID: "9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481"). InnerVolumeSpecName "kube-api-access-g42jd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:18:59.521116 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:59.521089    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w68c2"
Jul 02 23:18:59.539661 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:59.539602    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g42jd\" (UniqueName: \"kubernetes.io/projected/9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481-kube-api-access-g42jd\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:18:59.640872 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:59.640836    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6987v\" (UniqueName: \"kubernetes.io/projected/b5074456-b1db-4886-b5af-a9e4f909ab5a-kube-api-access-6987v\") pod \"b5074456-b1db-4886-b5af-a9e4f909ab5a\" (UID: \"b5074456-b1db-4886-b5af-a9e4f909ab5a\") "
Jul 02 23:18:59.642866 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:59.642841    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5074456-b1db-4886-b5af-a9e4f909ab5a-kube-api-access-6987v" (OuterVolumeSpecName: "kube-api-access-6987v") pod "b5074456-b1db-4886-b5af-a9e4f909ab5a" (UID: "b5074456-b1db-4886-b5af-a9e4f909ab5a"). InnerVolumeSpecName "kube-api-access-6987v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:18:59.742133 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:18:59.742108    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6987v\" (UniqueName: \"kubernetes.io/projected/b5074456-b1db-4886-b5af-a9e4f909ab5a-kube-api-access-6987v\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:19:00.288237 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.288143    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575d9f5975-wqvzj" event={"ID":"7c97e524-fa9f-492c-b1c7-1e152fa4ae12","Type":"ContainerStarted","Data":"dd44d1e8f6dae3a35e5d34a26aba0977d9b8e46a4f5888c9d54493d2032c6a58"}
Jul 02 23:19:00.289416 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.289391    2563 generic.go:356] "Generic (PLEG): container finished" podID="b5074456-b1db-4886-b5af-a9e4f909ab5a" containerID="d20be270740f28cac67c5940092cc622401b72399688a81dc8244d6e86363f43" exitCode=0
Jul 02 23:19:00.289522 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.289433    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w68c2"
Jul 02 23:19:00.289522 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.289474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w68c2" event={"ID":"b5074456-b1db-4886-b5af-a9e4f909ab5a","Type":"ContainerDied","Data":"d20be270740f28cac67c5940092cc622401b72399688a81dc8244d6e86363f43"}
Jul 02 23:19:00.289590 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.289527    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w68c2" event={"ID":"b5074456-b1db-4886-b5af-a9e4f909ab5a","Type":"ContainerDied","Data":"2ee757b36adf7d22fb92889e9650797d22f110d44c0b483e24cf0eb42bca1ac2"}
Jul 02 23:19:00.289590 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.289547    2563 scope.go:117] "RemoveContainer" containerID="d20be270740f28cac67c5940092cc622401b72399688a81dc8244d6e86363f43"
Jul 02 23:19:00.289590 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.289561    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c49bdb8bc-7jjhp"
Jul 02 23:19:00.297596 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.297578    2563 scope.go:117] "RemoveContainer" containerID="d20be270740f28cac67c5940092cc622401b72399688a81dc8244d6e86363f43"
Jul 02 23:19:00.297830 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:19:00.297811    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d20be270740f28cac67c5940092cc622401b72399688a81dc8244d6e86363f43\": container with ID starting with d20be270740f28cac67c5940092cc622401b72399688a81dc8244d6e86363f43 not found: ID does not exist" containerID="d20be270740f28cac67c5940092cc622401b72399688a81dc8244d6e86363f43"
Jul 02 23:19:00.297887 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.297838    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d20be270740f28cac67c5940092cc622401b72399688a81dc8244d6e86363f43"} err="failed to get container status \"d20be270740f28cac67c5940092cc622401b72399688a81dc8244d6e86363f43\": rpc error: code = NotFound desc = could not find container \"d20be270740f28cac67c5940092cc622401b72399688a81dc8244d6e86363f43\": container with ID starting with d20be270740f28cac67c5940092cc622401b72399688a81dc8244d6e86363f43 not found: ID does not exist"
Jul 02 23:19:00.305479 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.305443    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-575d9f5975-wqvzj" podStartSLOduration=1.7999364949999999 podStartE2EDuration="2.305431216s" totalImagesPullingTime="505.494721ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:19:00.304011158 +0000 UTC m=+488.928429535" watchObservedRunningTime="2026-07-02 23:19:00.305431216 +0000 UTC m=+488.929849591"
Jul 02 23:19:00.320552 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.320530    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w68c2"]
Jul 02 23:19:00.326184 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.326165    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w68c2"]
Jul 02 23:19:00.334721 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.334701    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bwz94"]
Jul 02 23:19:00.334956 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.334932    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-bwz94" podUID="ef1f20b4-2aaa-4335-9728-91e2437fc33c" containerName="authorino" containerID="cri-o://3fd1e0a403b48f05efccf8182b678ec33feb6ed00b8c6031f4a68c71884b073e" gracePeriod=30
Jul 02 23:19:00.356825 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.356802    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c49bdb8bc-7jjhp"]
Jul 02 23:19:00.359486 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.359466    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c49bdb8bc-7jjhp"]
Jul 02 23:19:00.579216 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.579188    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bwz94"
Jul 02 23:19:00.648699 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.648667    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlp6j\" (UniqueName: \"kubernetes.io/projected/ef1f20b4-2aaa-4335-9728-91e2437fc33c-kube-api-access-qlp6j\") pod \"ef1f20b4-2aaa-4335-9728-91e2437fc33c\" (UID: \"ef1f20b4-2aaa-4335-9728-91e2437fc33c\") "
Jul 02 23:19:00.650656 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.650630    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef1f20b4-2aaa-4335-9728-91e2437fc33c-kube-api-access-qlp6j" (OuterVolumeSpecName: "kube-api-access-qlp6j") pod "ef1f20b4-2aaa-4335-9728-91e2437fc33c" (UID: "ef1f20b4-2aaa-4335-9728-91e2437fc33c"). InnerVolumeSpecName "kube-api-access-qlp6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:19:00.749745 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:00.749720    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlp6j\" (UniqueName: \"kubernetes.io/projected/ef1f20b4-2aaa-4335-9728-91e2437fc33c-kube-api-access-qlp6j\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:19:01.296611 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:01.296577    2563 generic.go:356] "Generic (PLEG): container finished" podID="ef1f20b4-2aaa-4335-9728-91e2437fc33c" containerID="3fd1e0a403b48f05efccf8182b678ec33feb6ed00b8c6031f4a68c71884b073e" exitCode=0
Jul 02 23:19:01.297077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:01.296619    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bwz94"
Jul 02 23:19:01.297077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:01.296658    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bwz94" event={"ID":"ef1f20b4-2aaa-4335-9728-91e2437fc33c","Type":"ContainerDied","Data":"3fd1e0a403b48f05efccf8182b678ec33feb6ed00b8c6031f4a68c71884b073e"}
Jul 02 23:19:01.297077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:01.296695    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bwz94" event={"ID":"ef1f20b4-2aaa-4335-9728-91e2437fc33c","Type":"ContainerDied","Data":"177583da3bd7668cd0fde50fe72b21ac64aa5e0640dfb5d4889290c260d04a47"}
Jul 02 23:19:01.297077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:01.296711    2563 scope.go:117] "RemoveContainer" containerID="3fd1e0a403b48f05efccf8182b678ec33feb6ed00b8c6031f4a68c71884b073e"
Jul 02 23:19:01.305444 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:01.305426    2563 scope.go:117] "RemoveContainer" containerID="3fd1e0a403b48f05efccf8182b678ec33feb6ed00b8c6031f4a68c71884b073e"
Jul 02 23:19:01.305692 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:19:01.305674    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fd1e0a403b48f05efccf8182b678ec33feb6ed00b8c6031f4a68c71884b073e\": container with ID starting with 3fd1e0a403b48f05efccf8182b678ec33feb6ed00b8c6031f4a68c71884b073e not found: ID does not exist" containerID="3fd1e0a403b48f05efccf8182b678ec33feb6ed00b8c6031f4a68c71884b073e"
Jul 02 23:19:01.305727 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:01.305700    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd1e0a403b48f05efccf8182b678ec33feb6ed00b8c6031f4a68c71884b073e"} err="failed to get container status \"3fd1e0a403b48f05efccf8182b678ec33feb6ed00b8c6031f4a68c71884b073e\": rpc error: code = NotFound desc = could not find container \"3fd1e0a403b48f05efccf8182b678ec33feb6ed00b8c6031f4a68c71884b073e\": container with ID starting with 3fd1e0a403b48f05efccf8182b678ec33feb6ed00b8c6031f4a68c71884b073e not found: ID does not exist"
Jul 02 23:19:01.317453 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:01.317432    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bwz94"]
Jul 02 23:19:01.321076 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:01.321057    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bwz94"]
Jul 02 23:19:01.885611 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:01.885578    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481" path="/var/lib/kubelet/pods/9dea6f9e-e0a3-40f6-83cb-cfb2c05ca481/volumes"
Jul 02 23:19:01.885800 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:01.885787    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5074456-b1db-4886-b5af-a9e4f909ab5a" path="/var/lib/kubelet/pods/b5074456-b1db-4886-b5af-a9e4f909ab5a/volumes"
Jul 02 23:19:01.886091 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:01.886079    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef1f20b4-2aaa-4335-9728-91e2437fc33c" path="/var/lib/kubelet/pods/ef1f20b4-2aaa-4335-9728-91e2437fc33c/volumes"
Jul 02 23:19:04.857031 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:04.857000    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58bb66898f-x89bm"]
Jul 02 23:19:04.857419 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:04.857318    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1f20b4-2aaa-4335-9728-91e2437fc33c" containerName="authorino"
Jul 02 23:19:04.857419 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:04.857328    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1f20b4-2aaa-4335-9728-91e2437fc33c" containerName="authorino"
Jul 02 23:19:04.857419 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:04.857337    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5074456-b1db-4886-b5af-a9e4f909ab5a" containerName="authorino"
Jul 02 23:19:04.857419 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:04.857342    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5074456-b1db-4886-b5af-a9e4f909ab5a" containerName="authorino"
Jul 02 23:19:04.857419 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:04.857396    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5074456-b1db-4886-b5af-a9e4f909ab5a" containerName="authorino"
Jul 02 23:19:04.857419 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:04.857406    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef1f20b4-2aaa-4335-9728-91e2437fc33c" containerName="authorino"
Jul 02 23:19:04.861611 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:04.861596    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58bb66898f-x89bm"
Jul 02 23:19:04.864216 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:04.864179    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 23:19:04.864334 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:04.864230    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 23:19:04.864334 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:04.864248    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mms8x\""
Jul 02 23:19:04.875927 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:04.875873    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58bb66898f-x89bm"]
Jul 02 23:19:04.983485 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:04.983453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d12fe4d8-52a8-4ce2-b3ce-13550244ffad-webhook-cert\") pod \"maas-controller-58bb66898f-x89bm\" (UID: \"d12fe4d8-52a8-4ce2-b3ce-13550244ffad\") " pod="opendatahub/maas-controller-58bb66898f-x89bm"
Jul 02 23:19:04.983620 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:04.983503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slk78\" (UniqueName: \"kubernetes.io/projected/d12fe4d8-52a8-4ce2-b3ce-13550244ffad-kube-api-access-slk78\") pod \"maas-controller-58bb66898f-x89bm\" (UID: \"d12fe4d8-52a8-4ce2-b3ce-13550244ffad\") " pod="opendatahub/maas-controller-58bb66898f-x89bm"
Jul 02 23:19:05.083887 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:05.083860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d12fe4d8-52a8-4ce2-b3ce-13550244ffad-webhook-cert\") pod \"maas-controller-58bb66898f-x89bm\" (UID: \"d12fe4d8-52a8-4ce2-b3ce-13550244ffad\") " pod="opendatahub/maas-controller-58bb66898f-x89bm"
Jul 02 23:19:05.084063 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:05.083908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slk78\" (UniqueName: \"kubernetes.io/projected/d12fe4d8-52a8-4ce2-b3ce-13550244ffad-kube-api-access-slk78\") pod \"maas-controller-58bb66898f-x89bm\" (UID: \"d12fe4d8-52a8-4ce2-b3ce-13550244ffad\") " pod="opendatahub/maas-controller-58bb66898f-x89bm"
Jul 02 23:19:05.086272 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:05.086255    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d12fe4d8-52a8-4ce2-b3ce-13550244ffad-webhook-cert\") pod \"maas-controller-58bb66898f-x89bm\" (UID: \"d12fe4d8-52a8-4ce2-b3ce-13550244ffad\") " pod="opendatahub/maas-controller-58bb66898f-x89bm"
Jul 02 23:19:05.095196 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:05.095176    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slk78\" (UniqueName: \"kubernetes.io/projected/d12fe4d8-52a8-4ce2-b3ce-13550244ffad-kube-api-access-slk78\") pod \"maas-controller-58bb66898f-x89bm\" (UID: \"d12fe4d8-52a8-4ce2-b3ce-13550244ffad\") " pod="opendatahub/maas-controller-58bb66898f-x89bm"
Jul 02 23:19:05.171633 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:05.171576    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58bb66898f-x89bm"
Jul 02 23:19:05.310424 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:05.310400    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58bb66898f-x89bm"]
Jul 02 23:19:05.312854 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:19:05.312824    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd12fe4d8_52a8_4ce2_b3ce_13550244ffad.slice/crio-7cf9c453ffdaed3c2a093a9eb840d345a68fe2c0a5112ae460dddb24ec249166 WatchSource:0}: Error finding container 7cf9c453ffdaed3c2a093a9eb840d345a68fe2c0a5112ae460dddb24ec249166: Status 404 returned error can't find the container with id 7cf9c453ffdaed3c2a093a9eb840d345a68fe2c0a5112ae460dddb24ec249166
Jul 02 23:19:05.322930 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:05.322894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58bb66898f-x89bm" event={"ID":"d12fe4d8-52a8-4ce2-b3ce-13550244ffad","Type":"ContainerStarted","Data":"7cf9c453ffdaed3c2a093a9eb840d345a68fe2c0a5112ae460dddb24ec249166"}
Jul 02 23:19:08.340474 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:08.340436    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58bb66898f-x89bm" event={"ID":"d12fe4d8-52a8-4ce2-b3ce-13550244ffad","Type":"ContainerStarted","Data":"5a71538b71b30dd757a4afa7f8e473e6503c35037aeffafebc4fd0202e41e656"}
Jul 02 23:19:08.341055 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:08.340576    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58bb66898f-x89bm"
Jul 02 23:19:08.361878 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:08.361832    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58bb66898f-x89bm" podStartSLOduration=2.356544169 podStartE2EDuration="4.361817439s" totalImagesPullingTime="2.00527327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:19:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:19:08.360717591 +0000 UTC m=+496.985135991" watchObservedRunningTime="2026-07-02 23:19:08.361817439 +0000 UTC m=+496.986235841"
Jul 02 23:19:19.351274 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:19.351242    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58bb66898f-x89bm"
Jul 02 23:19:39.568542 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:39.568509    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7bc66f69d9-f4x49"]
Jul 02 23:19:39.573231 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:39.573210    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7bc66f69d9-f4x49"
Jul 02 23:19:39.576204 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:39.576184    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-gbhnx\""
Jul 02 23:19:39.576292 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:39.576222    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 02 23:19:39.583996 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:39.583975    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7bc66f69d9-f4x49"]
Jul 02 23:19:39.664514 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:39.664483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3af4915-5f65-4312-98dd-343bcd52814b-maas-api-tls\") pod \"maas-api-7bc66f69d9-f4x49\" (UID: \"f3af4915-5f65-4312-98dd-343bcd52814b\") " pod="opendatahub/maas-api-7bc66f69d9-f4x49"
Jul 02 23:19:39.664680 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:39.664525    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3af4915-5f65-4312-98dd-343bcd52814b-openshift-service-ca\") pod \"maas-api-7bc66f69d9-f4x49\" (UID: \"f3af4915-5f65-4312-98dd-343bcd52814b\") " pod="opendatahub/maas-api-7bc66f69d9-f4x49"
Jul 02 23:19:39.664680 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:39.664632    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjg7k\" (UniqueName: \"kubernetes.io/projected/f3af4915-5f65-4312-98dd-343bcd52814b-kube-api-access-tjg7k\") pod \"maas-api-7bc66f69d9-f4x49\" (UID: \"f3af4915-5f65-4312-98dd-343bcd52814b\") " pod="opendatahub/maas-api-7bc66f69d9-f4x49"
Jul 02 23:19:39.765912 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:39.765820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3af4915-5f65-4312-98dd-343bcd52814b-maas-api-tls\") pod \"maas-api-7bc66f69d9-f4x49\" (UID: \"f3af4915-5f65-4312-98dd-343bcd52814b\") " pod="opendatahub/maas-api-7bc66f69d9-f4x49"
Jul 02 23:19:39.766077 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:19:39.765908    2563 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 02 23:19:39.766077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:39.765974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3af4915-5f65-4312-98dd-343bcd52814b-openshift-service-ca\") pod \"maas-api-7bc66f69d9-f4x49\" (UID: \"f3af4915-5f65-4312-98dd-343bcd52814b\") " pod="opendatahub/maas-api-7bc66f69d9-f4x49"
Jul 02 23:19:39.766077 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:19:39.765986    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3af4915-5f65-4312-98dd-343bcd52814b-maas-api-tls podName:f3af4915-5f65-4312-98dd-343bcd52814b nodeName:}" failed. No retries permitted until 2026-07-02 23:19:40.265964997 +0000 UTC m=+528.890383357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f3af4915-5f65-4312-98dd-343bcd52814b-maas-api-tls") pod "maas-api-7bc66f69d9-f4x49" (UID: "f3af4915-5f65-4312-98dd-343bcd52814b") : secret "maas-api-serving-cert" not found
Jul 02 23:19:39.766077 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:39.766053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjg7k\" (UniqueName: \"kubernetes.io/projected/f3af4915-5f65-4312-98dd-343bcd52814b-kube-api-access-tjg7k\") pod \"maas-api-7bc66f69d9-f4x49\" (UID: \"f3af4915-5f65-4312-98dd-343bcd52814b\") " pod="opendatahub/maas-api-7bc66f69d9-f4x49"
Jul 02 23:19:39.766538 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:39.766521    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3af4915-5f65-4312-98dd-343bcd52814b-openshift-service-ca\") pod \"maas-api-7bc66f69d9-f4x49\" (UID: \"f3af4915-5f65-4312-98dd-343bcd52814b\") " pod="opendatahub/maas-api-7bc66f69d9-f4x49"
Jul 02 23:19:39.775480 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:39.775459    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjg7k\" (UniqueName: \"kubernetes.io/projected/f3af4915-5f65-4312-98dd-343bcd52814b-kube-api-access-tjg7k\") pod \"maas-api-7bc66f69d9-f4x49\" (UID: \"f3af4915-5f65-4312-98dd-343bcd52814b\") " pod="opendatahub/maas-api-7bc66f69d9-f4x49"
Jul 02 23:19:40.272160 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:40.272123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3af4915-5f65-4312-98dd-343bcd52814b-maas-api-tls\") pod \"maas-api-7bc66f69d9-f4x49\" (UID: \"f3af4915-5f65-4312-98dd-343bcd52814b\") " pod="opendatahub/maas-api-7bc66f69d9-f4x49"
Jul 02 23:19:40.274562 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:40.274538    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3af4915-5f65-4312-98dd-343bcd52814b-maas-api-tls\") pod \"maas-api-7bc66f69d9-f4x49\" (UID: \"f3af4915-5f65-4312-98dd-343bcd52814b\") " pod="opendatahub/maas-api-7bc66f69d9-f4x49"
Jul 02 23:19:40.483766 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:40.483727    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7bc66f69d9-f4x49"
Jul 02 23:19:40.615400 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:40.615374    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7bc66f69d9-f4x49"]
Jul 02 23:19:40.617218 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:19:40.617190    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3af4915_5f65_4312_98dd_343bcd52814b.slice/crio-07c758ee1a618bc3220d86e832a23047f4e779dba0dfb167974bfbb2b9570603 WatchSource:0}: Error finding container 07c758ee1a618bc3220d86e832a23047f4e779dba0dfb167974bfbb2b9570603: Status 404 returned error can't find the container with id 07c758ee1a618bc3220d86e832a23047f4e779dba0dfb167974bfbb2b9570603
Jul 02 23:19:41.496182 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:41.496140    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7bc66f69d9-f4x49" event={"ID":"f3af4915-5f65-4312-98dd-343bcd52814b","Type":"ContainerStarted","Data":"07c758ee1a618bc3220d86e832a23047f4e779dba0dfb167974bfbb2b9570603"}
Jul 02 23:19:42.502165 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:42.502122    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7bc66f69d9-f4x49" event={"ID":"f3af4915-5f65-4312-98dd-343bcd52814b","Type":"ContainerStarted","Data":"2e9f4625ce43ebd42bc8616f514fde43a46d27e70d1c1b2986dcd53eece2076f"}
Jul 02 23:19:42.502559 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:42.502240    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7bc66f69d9-f4x49"
Jul 02 23:19:42.520081 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:42.520031    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7bc66f69d9-f4x49" podStartSLOduration=2.114726405 podStartE2EDuration="3.520017745s" totalImagesPullingTime="1.40529134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:19:42.518405147 +0000 UTC m=+531.142823523" watchObservedRunningTime="2026-07-02 23:19:42.520017745 +0000 UTC m=+531.144436127"
Jul 02 23:19:48.511776 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:19:48.511706    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7bc66f69d9-f4x49"
Jul 02 23:20:24.093258 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.093226    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"]
Jul 02 23:20:24.098459 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.098440    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.101318 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.101300    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 23:20:24.102600 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.102582    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8wqs2\""
Jul 02 23:20:24.102686 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.102625    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 23:20:24.102958 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.102907    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 02 23:20:24.108143 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.108120    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"]
Jul 02 23:20:24.208962 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.208933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4db993a4-f7d3-4f34-9274-11d5d82b807a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.209089 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.208965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lz2w\" (UniqueName: \"kubernetes.io/projected/4db993a4-f7d3-4f34-9274-11d5d82b807a-kube-api-access-2lz2w\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.209089 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.208998    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4db993a4-f7d3-4f34-9274-11d5d82b807a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.209089 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.209069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4db993a4-f7d3-4f34-9274-11d5d82b807a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.209191 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.209117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4db993a4-f7d3-4f34-9274-11d5d82b807a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.209191 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.209156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4db993a4-f7d3-4f34-9274-11d5d82b807a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.309633 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.309593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4db993a4-f7d3-4f34-9274-11d5d82b807a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.309633 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.309641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4db993a4-f7d3-4f34-9274-11d5d82b807a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.309817 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.309658    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lz2w\" (UniqueName: \"kubernetes.io/projected/4db993a4-f7d3-4f34-9274-11d5d82b807a-kube-api-access-2lz2w\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.309817 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.309693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4db993a4-f7d3-4f34-9274-11d5d82b807a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.309817 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.309733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4db993a4-f7d3-4f34-9274-11d5d82b807a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.309817 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.309775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4db993a4-f7d3-4f34-9274-11d5d82b807a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.310167 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.310133    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4db993a4-f7d3-4f34-9274-11d5d82b807a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.310167 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.310139    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4db993a4-f7d3-4f34-9274-11d5d82b807a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.310309 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.310187    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4db993a4-f7d3-4f34-9274-11d5d82b807a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.311809 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.311783    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4db993a4-f7d3-4f34-9274-11d5d82b807a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.312132 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.312111    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4db993a4-f7d3-4f34-9274-11d5d82b807a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.319091 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.319070    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lz2w\" (UniqueName: \"kubernetes.io/projected/4db993a4-f7d3-4f34-9274-11d5d82b807a-kube-api-access-2lz2w\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ps9k2\" (UID: \"4db993a4-f7d3-4f34-9274-11d5d82b807a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.408911 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.408858    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:24.537315 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.537289    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"]
Jul 02 23:20:24.539228 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:20:24.539203    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db993a4_f7d3_4f34_9274_11d5d82b807a.slice/crio-4fc082189da4a01d7e34d8479aa6c2de3ed9f43b45a7978349543724f28795c6 WatchSource:0}: Error finding container 4fc082189da4a01d7e34d8479aa6c2de3ed9f43b45a7978349543724f28795c6: Status 404 returned error can't find the container with id 4fc082189da4a01d7e34d8479aa6c2de3ed9f43b45a7978349543724f28795c6
Jul 02 23:20:24.696928 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:24.696846    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2" event={"ID":"4db993a4-f7d3-4f34-9274-11d5d82b807a","Type":"ContainerStarted","Data":"4fc082189da4a01d7e34d8479aa6c2de3ed9f43b45a7978349543724f28795c6"}
Jul 02 23:20:26.706662 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:26.706630    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2" event={"ID":"4db993a4-f7d3-4f34-9274-11d5d82b807a","Type":"ContainerStarted","Data":"21baaa6e5b703bf4afcb199fad3bddd4c9431bbb883dd7c3cd7f3980c261007a"}
Jul 02 23:20:26.724510 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:26.724464    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2" podStartSLOduration=1.616209676 podStartE2EDuration="2.724448384s" totalImagesPullingTime="1.108238708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:20:26.723264303 +0000 UTC m=+575.347682695" watchObservedRunningTime="2026-07-02 23:20:26.724448384 +0000 UTC m=+575.348866758"
Jul 02 23:20:34.409994 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:34.409967    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:34.410448 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:34.410074    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:34.422106 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:34.422086    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:34.753022 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:34.752949    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ps9k2"
Jul 02 23:20:51.785009 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:51.784984    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:20:51.803018 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:20:51.802998    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:22:13.030490 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:13.030458    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76fdf5c8c4-xkj2x"]
Jul 02 23:22:13.033746 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:13.033730    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76fdf5c8c4-xkj2x"
Jul 02 23:22:13.040952 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:13.040906    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76fdf5c8c4-xkj2x"]
Jul 02 23:22:13.122576 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:13.122540    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e23e79b1-0a34-4395-b4b2-43c204266296-tls-cert\") pod \"authorino-76fdf5c8c4-xkj2x\" (UID: \"e23e79b1-0a34-4395-b4b2-43c204266296\") " pod="kuadrant-system/authorino-76fdf5c8c4-xkj2x"
Jul 02 23:22:13.122751 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:13.122604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m7m4\" (UniqueName: \"kubernetes.io/projected/e23e79b1-0a34-4395-b4b2-43c204266296-kube-api-access-5m7m4\") pod \"authorino-76fdf5c8c4-xkj2x\" (UID: \"e23e79b1-0a34-4395-b4b2-43c204266296\") " pod="kuadrant-system/authorino-76fdf5c8c4-xkj2x"
Jul 02 23:22:13.224011 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:13.223974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m7m4\" (UniqueName: \"kubernetes.io/projected/e23e79b1-0a34-4395-b4b2-43c204266296-kube-api-access-5m7m4\") pod \"authorino-76fdf5c8c4-xkj2x\" (UID: \"e23e79b1-0a34-4395-b4b2-43c204266296\") " pod="kuadrant-system/authorino-76fdf5c8c4-xkj2x"
Jul 02 23:22:13.224170 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:13.224048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e23e79b1-0a34-4395-b4b2-43c204266296-tls-cert\") pod \"authorino-76fdf5c8c4-xkj2x\" (UID: \"e23e79b1-0a34-4395-b4b2-43c204266296\") " pod="kuadrant-system/authorino-76fdf5c8c4-xkj2x"
Jul 02 23:22:13.226485 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:13.226464    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e23e79b1-0a34-4395-b4b2-43c204266296-tls-cert\") pod \"authorino-76fdf5c8c4-xkj2x\" (UID: \"e23e79b1-0a34-4395-b4b2-43c204266296\") " pod="kuadrant-system/authorino-76fdf5c8c4-xkj2x"
Jul 02 23:22:13.232538 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:13.232517    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m7m4\" (UniqueName: \"kubernetes.io/projected/e23e79b1-0a34-4395-b4b2-43c204266296-kube-api-access-5m7m4\") pod \"authorino-76fdf5c8c4-xkj2x\" (UID: \"e23e79b1-0a34-4395-b4b2-43c204266296\") " pod="kuadrant-system/authorino-76fdf5c8c4-xkj2x"
Jul 02 23:22:13.343204 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:13.343173    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76fdf5c8c4-xkj2x"
Jul 02 23:22:13.474232 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:13.474188    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76fdf5c8c4-xkj2x"]
Jul 02 23:22:13.477213 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:22:13.477183    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode23e79b1_0a34_4395_b4b2_43c204266296.slice/crio-4ee30a14086ca674c0fe6acae8ffce29482d00f2806e490782da0bc697656567 WatchSource:0}: Error finding container 4ee30a14086ca674c0fe6acae8ffce29482d00f2806e490782da0bc697656567: Status 404 returned error can't find the container with id 4ee30a14086ca674c0fe6acae8ffce29482d00f2806e490782da0bc697656567
Jul 02 23:22:13.478522 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:13.478501    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:22:14.206502 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:14.206363    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76fdf5c8c4-xkj2x" event={"ID":"e23e79b1-0a34-4395-b4b2-43c204266296","Type":"ContainerStarted","Data":"78060eae94ee9e74237058365bf635c5ae19f3daa673e238f1ef556def3b43eb"}
Jul 02 23:22:14.206502 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:14.206451    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76fdf5c8c4-xkj2x" event={"ID":"e23e79b1-0a34-4395-b4b2-43c204266296","Type":"ContainerStarted","Data":"4ee30a14086ca674c0fe6acae8ffce29482d00f2806e490782da0bc697656567"}
Jul 02 23:22:14.225178 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:14.225097    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76fdf5c8c4-xkj2x" podStartSLOduration=0.762972078 podStartE2EDuration="1.225078918s" totalImagesPullingTime="462.10684ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:22:14.224025804 +0000 UTC m=+682.848444181" watchObservedRunningTime="2026-07-02 23:22:14.225078918 +0000 UTC m=+682.849497294"
Jul 02 23:22:14.262711 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:14.262674    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-575d9f5975-wqvzj"]
Jul 02 23:22:14.263183 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:14.263142    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-575d9f5975-wqvzj" podUID="7c97e524-fa9f-492c-b1c7-1e152fa4ae12" containerName="authorino" containerID="cri-o://dd44d1e8f6dae3a35e5d34a26aba0977d9b8e46a4f5888c9d54493d2032c6a58" gracePeriod=30
Jul 02 23:22:14.530738 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:14.530713    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575d9f5975-wqvzj"
Jul 02 23:22:14.638415 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:14.638377    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7c97e524-fa9f-492c-b1c7-1e152fa4ae12-tls-cert\") pod \"7c97e524-fa9f-492c-b1c7-1e152fa4ae12\" (UID: \"7c97e524-fa9f-492c-b1c7-1e152fa4ae12\") "
Jul 02 23:22:14.638577 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:14.638497    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkwr6\" (UniqueName: \"kubernetes.io/projected/7c97e524-fa9f-492c-b1c7-1e152fa4ae12-kube-api-access-bkwr6\") pod \"7c97e524-fa9f-492c-b1c7-1e152fa4ae12\" (UID: \"7c97e524-fa9f-492c-b1c7-1e152fa4ae12\") "
Jul 02 23:22:14.640639 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:14.640603    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c97e524-fa9f-492c-b1c7-1e152fa4ae12-kube-api-access-bkwr6" (OuterVolumeSpecName: "kube-api-access-bkwr6") pod "7c97e524-fa9f-492c-b1c7-1e152fa4ae12" (UID: "7c97e524-fa9f-492c-b1c7-1e152fa4ae12"). InnerVolumeSpecName "kube-api-access-bkwr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:22:14.649116 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:14.649092    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c97e524-fa9f-492c-b1c7-1e152fa4ae12-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7c97e524-fa9f-492c-b1c7-1e152fa4ae12" (UID: "7c97e524-fa9f-492c-b1c7-1e152fa4ae12"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:22:14.739379 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:14.739334    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkwr6\" (UniqueName: \"kubernetes.io/projected/7c97e524-fa9f-492c-b1c7-1e152fa4ae12-kube-api-access-bkwr6\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:22:14.739379 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:14.739371    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7c97e524-fa9f-492c-b1c7-1e152fa4ae12-tls-cert\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:22:15.212845 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:15.212808    2563 generic.go:356] "Generic (PLEG): container finished" podID="7c97e524-fa9f-492c-b1c7-1e152fa4ae12" containerID="dd44d1e8f6dae3a35e5d34a26aba0977d9b8e46a4f5888c9d54493d2032c6a58" exitCode=0
Jul 02 23:22:15.213364 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:15.212873    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-575d9f5975-wqvzj"
Jul 02 23:22:15.213364 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:15.212909    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575d9f5975-wqvzj" event={"ID":"7c97e524-fa9f-492c-b1c7-1e152fa4ae12","Type":"ContainerDied","Data":"dd44d1e8f6dae3a35e5d34a26aba0977d9b8e46a4f5888c9d54493d2032c6a58"}
Jul 02 23:22:15.213364 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:15.212970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-575d9f5975-wqvzj" event={"ID":"7c97e524-fa9f-492c-b1c7-1e152fa4ae12","Type":"ContainerDied","Data":"46f8cc402bedf87d5b87e30e4b06e61de6483d5a1f8995271f932d6223f60b22"}
Jul 02 23:22:15.213364 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:15.212994    2563 scope.go:117] "RemoveContainer" containerID="dd44d1e8f6dae3a35e5d34a26aba0977d9b8e46a4f5888c9d54493d2032c6a58"
Jul 02 23:22:15.222761 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:15.222743    2563 scope.go:117] "RemoveContainer" containerID="dd44d1e8f6dae3a35e5d34a26aba0977d9b8e46a4f5888c9d54493d2032c6a58"
Jul 02 23:22:15.223119 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:22:15.223097    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd44d1e8f6dae3a35e5d34a26aba0977d9b8e46a4f5888c9d54493d2032c6a58\": container with ID starting with dd44d1e8f6dae3a35e5d34a26aba0977d9b8e46a4f5888c9d54493d2032c6a58 not found: ID does not exist" containerID="dd44d1e8f6dae3a35e5d34a26aba0977d9b8e46a4f5888c9d54493d2032c6a58"
Jul 02 23:22:15.223191 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:15.223132    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd44d1e8f6dae3a35e5d34a26aba0977d9b8e46a4f5888c9d54493d2032c6a58"} err="failed to get container status \"dd44d1e8f6dae3a35e5d34a26aba0977d9b8e46a4f5888c9d54493d2032c6a58\": rpc error: code = NotFound desc = could not find container \"dd44d1e8f6dae3a35e5d34a26aba0977d9b8e46a4f5888c9d54493d2032c6a58\": container with ID starting with dd44d1e8f6dae3a35e5d34a26aba0977d9b8e46a4f5888c9d54493d2032c6a58 not found: ID does not exist"
Jul 02 23:22:15.237221 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:15.237189    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-575d9f5975-wqvzj"]
Jul 02 23:22:15.240303 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:15.240279    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-575d9f5975-wqvzj"]
Jul 02 23:22:15.886371 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:22:15.886337    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c97e524-fa9f-492c-b1c7-1e152fa4ae12" path="/var/lib/kubelet/pods/7c97e524-fa9f-492c-b1c7-1e152fa4ae12/volumes"
Jul 02 23:23:26.856483 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:26.856443    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58bb66898f-x89bm"]
Jul 02 23:23:26.857031 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:26.856651    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-58bb66898f-x89bm" podUID="d12fe4d8-52a8-4ce2-b3ce-13550244ffad" containerName="manager" containerID="cri-o://5a71538b71b30dd757a4afa7f8e473e6503c35037aeffafebc4fd0202e41e656" gracePeriod=30
Jul 02 23:23:27.105143 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.105117    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58bb66898f-x89bm"
Jul 02 23:23:27.257401 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.257322    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d12fe4d8-52a8-4ce2-b3ce-13550244ffad-webhook-cert\") pod \"d12fe4d8-52a8-4ce2-b3ce-13550244ffad\" (UID: \"d12fe4d8-52a8-4ce2-b3ce-13550244ffad\") "
Jul 02 23:23:27.257401 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.257361    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slk78\" (UniqueName: \"kubernetes.io/projected/d12fe4d8-52a8-4ce2-b3ce-13550244ffad-kube-api-access-slk78\") pod \"d12fe4d8-52a8-4ce2-b3ce-13550244ffad\" (UID: \"d12fe4d8-52a8-4ce2-b3ce-13550244ffad\") "
Jul 02 23:23:27.259561 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.259531    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d12fe4d8-52a8-4ce2-b3ce-13550244ffad-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d12fe4d8-52a8-4ce2-b3ce-13550244ffad" (UID: "d12fe4d8-52a8-4ce2-b3ce-13550244ffad"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:23:27.259637 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.259581    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d12fe4d8-52a8-4ce2-b3ce-13550244ffad-kube-api-access-slk78" (OuterVolumeSpecName: "kube-api-access-slk78") pod "d12fe4d8-52a8-4ce2-b3ce-13550244ffad" (UID: "d12fe4d8-52a8-4ce2-b3ce-13550244ffad"). InnerVolumeSpecName "kube-api-access-slk78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:23:27.358899 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.358865    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d12fe4d8-52a8-4ce2-b3ce-13550244ffad-webhook-cert\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:23:27.358899 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.358894    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slk78\" (UniqueName: \"kubernetes.io/projected/d12fe4d8-52a8-4ce2-b3ce-13550244ffad-kube-api-access-slk78\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:23:27.557535 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.557452    2563 generic.go:356] "Generic (PLEG): container finished" podID="d12fe4d8-52a8-4ce2-b3ce-13550244ffad" containerID="5a71538b71b30dd757a4afa7f8e473e6503c35037aeffafebc4fd0202e41e656" exitCode=0
Jul 02 23:23:27.557535 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.557501    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58bb66898f-x89bm"
Jul 02 23:23:27.557701 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.557538    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58bb66898f-x89bm" event={"ID":"d12fe4d8-52a8-4ce2-b3ce-13550244ffad","Type":"ContainerDied","Data":"5a71538b71b30dd757a4afa7f8e473e6503c35037aeffafebc4fd0202e41e656"}
Jul 02 23:23:27.557701 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.557593    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58bb66898f-x89bm" event={"ID":"d12fe4d8-52a8-4ce2-b3ce-13550244ffad","Type":"ContainerDied","Data":"7cf9c453ffdaed3c2a093a9eb840d345a68fe2c0a5112ae460dddb24ec249166"}
Jul 02 23:23:27.557701 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.557620    2563 scope.go:117] "RemoveContainer" containerID="5a71538b71b30dd757a4afa7f8e473e6503c35037aeffafebc4fd0202e41e656"
Jul 02 23:23:27.566532 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.566515    2563 scope.go:117] "RemoveContainer" containerID="5a71538b71b30dd757a4afa7f8e473e6503c35037aeffafebc4fd0202e41e656"
Jul 02 23:23:27.566771 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:23:27.566753    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a71538b71b30dd757a4afa7f8e473e6503c35037aeffafebc4fd0202e41e656\": container with ID starting with 5a71538b71b30dd757a4afa7f8e473e6503c35037aeffafebc4fd0202e41e656 not found: ID does not exist" containerID="5a71538b71b30dd757a4afa7f8e473e6503c35037aeffafebc4fd0202e41e656"
Jul 02 23:23:27.566818 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.566778    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a71538b71b30dd757a4afa7f8e473e6503c35037aeffafebc4fd0202e41e656"} err="failed to get container status \"5a71538b71b30dd757a4afa7f8e473e6503c35037aeffafebc4fd0202e41e656\": rpc error: code = NotFound desc = could not find container \"5a71538b71b30dd757a4afa7f8e473e6503c35037aeffafebc4fd0202e41e656\": container with ID starting with 5a71538b71b30dd757a4afa7f8e473e6503c35037aeffafebc4fd0202e41e656 not found: ID does not exist"
Jul 02 23:23:27.585104 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.585078    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58bb66898f-x89bm"]
Jul 02 23:23:27.588003 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.587977    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58bb66898f-x89bm"]
Jul 02 23:23:27.885807 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:27.885775    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d12fe4d8-52a8-4ce2-b3ce-13550244ffad" path="/var/lib/kubelet/pods/d12fe4d8-52a8-4ce2-b3ce-13550244ffad/volumes"
Jul 02 23:23:28.363504 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.363468    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58bb66898f-zbbwm"]
Jul 02 23:23:28.363811 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.363800    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d12fe4d8-52a8-4ce2-b3ce-13550244ffad" containerName="manager"
Jul 02 23:23:28.363853 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.363813    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d12fe4d8-52a8-4ce2-b3ce-13550244ffad" containerName="manager"
Jul 02 23:23:28.363853 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.363835    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c97e524-fa9f-492c-b1c7-1e152fa4ae12" containerName="authorino"
Jul 02 23:23:28.363853 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.363841    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c97e524-fa9f-492c-b1c7-1e152fa4ae12" containerName="authorino"
Jul 02 23:23:28.363968 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.363896    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c97e524-fa9f-492c-b1c7-1e152fa4ae12" containerName="authorino"
Jul 02 23:23:28.363968 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.363903    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d12fe4d8-52a8-4ce2-b3ce-13550244ffad" containerName="manager"
Jul 02 23:23:28.368118 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.368102    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58bb66898f-zbbwm"
Jul 02 23:23:28.371111 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.371090    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 23:23:28.372410 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.372384    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 23:23:28.372472 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.372408    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mms8x\""
Jul 02 23:23:28.377518 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.377496    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58bb66898f-zbbwm"]
Jul 02 23:23:28.467797 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.467764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2886187-4e96-4ba5-9000-6fb5d4c4fc93-webhook-cert\") pod \"maas-controller-58bb66898f-zbbwm\" (UID: \"c2886187-4e96-4ba5-9000-6fb5d4c4fc93\") " pod="opendatahub/maas-controller-58bb66898f-zbbwm"
Jul 02 23:23:28.467965 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.467853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6v4d\" (UniqueName: \"kubernetes.io/projected/c2886187-4e96-4ba5-9000-6fb5d4c4fc93-kube-api-access-p6v4d\") pod \"maas-controller-58bb66898f-zbbwm\" (UID: \"c2886187-4e96-4ba5-9000-6fb5d4c4fc93\") " pod="opendatahub/maas-controller-58bb66898f-zbbwm"
Jul 02 23:23:28.568695 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.568668    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2886187-4e96-4ba5-9000-6fb5d4c4fc93-webhook-cert\") pod \"maas-controller-58bb66898f-zbbwm\" (UID: \"c2886187-4e96-4ba5-9000-6fb5d4c4fc93\") " pod="opendatahub/maas-controller-58bb66898f-zbbwm"
Jul 02 23:23:28.568862 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.568726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6v4d\" (UniqueName: \"kubernetes.io/projected/c2886187-4e96-4ba5-9000-6fb5d4c4fc93-kube-api-access-p6v4d\") pod \"maas-controller-58bb66898f-zbbwm\" (UID: \"c2886187-4e96-4ba5-9000-6fb5d4c4fc93\") " pod="opendatahub/maas-controller-58bb66898f-zbbwm"
Jul 02 23:23:28.571154 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.571132    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c2886187-4e96-4ba5-9000-6fb5d4c4fc93-webhook-cert\") pod \"maas-controller-58bb66898f-zbbwm\" (UID: \"c2886187-4e96-4ba5-9000-6fb5d4c4fc93\") " pod="opendatahub/maas-controller-58bb66898f-zbbwm"
Jul 02 23:23:28.577862 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.577831    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6v4d\" (UniqueName: \"kubernetes.io/projected/c2886187-4e96-4ba5-9000-6fb5d4c4fc93-kube-api-access-p6v4d\") pod \"maas-controller-58bb66898f-zbbwm\" (UID: \"c2886187-4e96-4ba5-9000-6fb5d4c4fc93\") " pod="opendatahub/maas-controller-58bb66898f-zbbwm"
Jul 02 23:23:28.679092 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.679011    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58bb66898f-zbbwm"
Jul 02 23:23:28.811208 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:28.811185    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58bb66898f-zbbwm"]
Jul 02 23:23:28.813654 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:23:28.813621    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2886187_4e96_4ba5_9000_6fb5d4c4fc93.slice/crio-ee01932b44a81f4d5de4bff39a62c04f612ac802fe7ffcbe61544fba4d781b89 WatchSource:0}: Error finding container ee01932b44a81f4d5de4bff39a62c04f612ac802fe7ffcbe61544fba4d781b89: Status 404 returned error can't find the container with id ee01932b44a81f4d5de4bff39a62c04f612ac802fe7ffcbe61544fba4d781b89
Jul 02 23:23:29.569217 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:29.569123    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58bb66898f-zbbwm" event={"ID":"c2886187-4e96-4ba5-9000-6fb5d4c4fc93","Type":"ContainerStarted","Data":"427f37e34e8ae1e43aec0c90d68af2ca057c2130fbd370f19c5071df268e9f76"}
Jul 02 23:23:29.569217 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:29.569206    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58bb66898f-zbbwm" event={"ID":"c2886187-4e96-4ba5-9000-6fb5d4c4fc93","Type":"ContainerStarted","Data":"ee01932b44a81f4d5de4bff39a62c04f612ac802fe7ffcbe61544fba4d781b89"}
Jul 02 23:23:29.569661 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:29.569352    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58bb66898f-zbbwm"
Jul 02 23:23:29.588655 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:29.588608    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58bb66898f-zbbwm" podStartSLOduration=1.226549693 podStartE2EDuration="1.588594076s" totalImagesPullingTime="362.044383ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:23:29.58627293 +0000 UTC m=+758.210691308" watchObservedRunningTime="2026-07-02 23:23:29.588594076 +0000 UTC m=+758.213012453"
Jul 02 23:23:40.580479 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:23:40.580451    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58bb66898f-zbbwm"
Jul 02 23:25:51.815247 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:25:51.815179    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:25:51.829330 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:25:51.829307    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:30:00.140054 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:00.140020    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717250-6r7pv"]
Jul 02 23:30:00.143303 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:00.143283    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717250-6r7pv"
Jul 02 23:30:00.153151 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:00.153123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717250-6r7pv"]
Jul 02 23:30:00.247453 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:00.247421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95668\" (UniqueName: \"kubernetes.io/projected/38bbef7a-c259-4e6e-89c8-07e80d244f38-kube-api-access-95668\") pod \"maas-api-key-cleanup-29717250-6r7pv\" (UID: \"38bbef7a-c259-4e6e-89c8-07e80d244f38\") " pod="opendatahub/maas-api-key-cleanup-29717250-6r7pv"
Jul 02 23:30:00.348617 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:00.348575    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95668\" (UniqueName: \"kubernetes.io/projected/38bbef7a-c259-4e6e-89c8-07e80d244f38-kube-api-access-95668\") pod \"maas-api-key-cleanup-29717250-6r7pv\" (UID: \"38bbef7a-c259-4e6e-89c8-07e80d244f38\") " pod="opendatahub/maas-api-key-cleanup-29717250-6r7pv"
Jul 02 23:30:00.357412 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:00.357375    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95668\" (UniqueName: \"kubernetes.io/projected/38bbef7a-c259-4e6e-89c8-07e80d244f38-kube-api-access-95668\") pod \"maas-api-key-cleanup-29717250-6r7pv\" (UID: \"38bbef7a-c259-4e6e-89c8-07e80d244f38\") " pod="opendatahub/maas-api-key-cleanup-29717250-6r7pv"
Jul 02 23:30:00.453737 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:00.453661    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717250-6r7pv"
Jul 02 23:30:00.586436 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:00.586385    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717250-6r7pv"]
Jul 02 23:30:00.588925 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:30:00.588877    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38bbef7a_c259_4e6e_89c8_07e80d244f38.slice/crio-4b8a7cb0739153565647b569bf03a0c6306a58d41000331d10352597ee83199a WatchSource:0}: Error finding container 4b8a7cb0739153565647b569bf03a0c6306a58d41000331d10352597ee83199a: Status 404 returned error can't find the container with id 4b8a7cb0739153565647b569bf03a0c6306a58d41000331d10352597ee83199a
Jul 02 23:30:00.590648 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:00.590634    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:30:01.444841 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:01.444804    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717250-6r7pv" event={"ID":"38bbef7a-c259-4e6e-89c8-07e80d244f38","Type":"ContainerStarted","Data":"4b8a7cb0739153565647b569bf03a0c6306a58d41000331d10352597ee83199a"}
Jul 02 23:30:04.462194 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:04.462163    2563 generic.go:356] "Generic (PLEG): container finished" podID="38bbef7a-c259-4e6e-89c8-07e80d244f38" containerID="b9e593ef76ab757083bf9979b23ef3885185c0842b56e4bfcf45992c6022e502" exitCode=0
Jul 02 23:30:04.462543 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:04.462201    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717250-6r7pv" event={"ID":"38bbef7a-c259-4e6e-89c8-07e80d244f38","Type":"ContainerDied","Data":"b9e593ef76ab757083bf9979b23ef3885185c0842b56e4bfcf45992c6022e502"}
Jul 02 23:30:05.595672 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:05.595651    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717250-6r7pv"
Jul 02 23:30:05.695408 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:05.695376    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95668\" (UniqueName: \"kubernetes.io/projected/38bbef7a-c259-4e6e-89c8-07e80d244f38-kube-api-access-95668\") pod \"38bbef7a-c259-4e6e-89c8-07e80d244f38\" (UID: \"38bbef7a-c259-4e6e-89c8-07e80d244f38\") "
Jul 02 23:30:05.697448 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:05.697406    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38bbef7a-c259-4e6e-89c8-07e80d244f38-kube-api-access-95668" (OuterVolumeSpecName: "kube-api-access-95668") pod "38bbef7a-c259-4e6e-89c8-07e80d244f38" (UID: "38bbef7a-c259-4e6e-89c8-07e80d244f38"). InnerVolumeSpecName "kube-api-access-95668". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:30:05.796070 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:05.796006    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95668\" (UniqueName: \"kubernetes.io/projected/38bbef7a-c259-4e6e-89c8-07e80d244f38-kube-api-access-95668\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:30:06.473022 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:06.472993    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717250-6r7pv"
Jul 02 23:30:06.473185 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:06.473023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717250-6r7pv" event={"ID":"38bbef7a-c259-4e6e-89c8-07e80d244f38","Type":"ContainerDied","Data":"4b8a7cb0739153565647b569bf03a0c6306a58d41000331d10352597ee83199a"}
Jul 02 23:30:06.473185 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:06.473063    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b8a7cb0739153565647b569bf03a0c6306a58d41000331d10352597ee83199a"
Jul 02 23:30:51.845566 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:51.845537    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:30:51.857713 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:30:51.857692    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:35:21.998490 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:21.998459    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"]
Jul 02 23:35:21.998937 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:21.998825    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38bbef7a-c259-4e6e-89c8-07e80d244f38" containerName="cleanup"
Jul 02 23:35:21.998937 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:21.998841    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="38bbef7a-c259-4e6e-89c8-07e80d244f38" containerName="cleanup"
Jul 02 23:35:21.999032 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:21.998939    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="38bbef7a-c259-4e6e-89c8-07e80d244f38" containerName="cleanup"
Jul 02 23:35:22.001776 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:22.001758    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"
Jul 02 23:35:22.004516 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:22.004466    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-cb663cc4-serving-cert\""
Jul 02 23:35:22.015263 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:22.015241    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"]
Jul 02 23:35:22.121801 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:22.121765    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq2f5\" (UniqueName: \"kubernetes.io/projected/21697822-c6f4-409b-b2a5-3bc210a20668-kube-api-access-kq2f5\") pod \"maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5\" (UID: \"21697822-c6f4-409b-b2a5-3bc210a20668\") " pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"
Jul 02 23:35:22.122004 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:22.121810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21697822-c6f4-409b-b2a5-3bc210a20668-openshift-service-ca\") pod \"maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5\" (UID: \"21697822-c6f4-409b-b2a5-3bc210a20668\") " pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"
Jul 02 23:35:22.122004 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:22.121904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21697822-c6f4-409b-b2a5-3bc210a20668-maas-api-tls\") pod \"maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5\" (UID: \"21697822-c6f4-409b-b2a5-3bc210a20668\") " pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"
Jul 02 23:35:22.222429 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:22.222399    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq2f5\" (UniqueName: \"kubernetes.io/projected/21697822-c6f4-409b-b2a5-3bc210a20668-kube-api-access-kq2f5\") pod \"maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5\" (UID: \"21697822-c6f4-409b-b2a5-3bc210a20668\") " pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"
Jul 02 23:35:22.222590 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:22.222436    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21697822-c6f4-409b-b2a5-3bc210a20668-openshift-service-ca\") pod \"maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5\" (UID: \"21697822-c6f4-409b-b2a5-3bc210a20668\") " pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"
Jul 02 23:35:22.222590 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:22.222561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21697822-c6f4-409b-b2a5-3bc210a20668-maas-api-tls\") pod \"maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5\" (UID: \"21697822-c6f4-409b-b2a5-3bc210a20668\") " pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"
Jul 02 23:35:22.223058 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:22.223040    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21697822-c6f4-409b-b2a5-3bc210a20668-openshift-service-ca\") pod \"maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5\" (UID: \"21697822-c6f4-409b-b2a5-3bc210a20668\") " pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"
Jul 02 23:35:22.225031 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:22.225010    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21697822-c6f4-409b-b2a5-3bc210a20668-maas-api-tls\") pod \"maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5\" (UID: \"21697822-c6f4-409b-b2a5-3bc210a20668\") " pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"
Jul 02 23:35:22.235114 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:22.235092    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq2f5\" (UniqueName: \"kubernetes.io/projected/21697822-c6f4-409b-b2a5-3bc210a20668-kube-api-access-kq2f5\") pod \"maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5\" (UID: \"21697822-c6f4-409b-b2a5-3bc210a20668\") " pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"
Jul 02 23:35:22.311778 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:22.311709    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"
Jul 02 23:35:22.443884 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:22.443860    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"]
Jul 02 23:35:22.445824 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:35:22.445789    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21697822_c6f4_409b_b2a5_3bc210a20668.slice/crio-b8d8219a5e54b448b8d8ec2232e8ac839949a8b56994c0a20afd800b16e16172 WatchSource:0}: Error finding container b8d8219a5e54b448b8d8ec2232e8ac839949a8b56994c0a20afd800b16e16172: Status 404 returned error can't find the container with id b8d8219a5e54b448b8d8ec2232e8ac839949a8b56994c0a20afd800b16e16172
Jul 02 23:35:22.447408 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:22.447389    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:35:23.008773 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:23.008748    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5" event={"ID":"21697822-c6f4-409b-b2a5-3bc210a20668","Type":"ContainerStarted","Data":"b8d8219a5e54b448b8d8ec2232e8ac839949a8b56994c0a20afd800b16e16172"}
Jul 02 23:35:24.015177 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:24.015141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5" event={"ID":"21697822-c6f4-409b-b2a5-3bc210a20668","Type":"ContainerStarted","Data":"3d3f6aa34516aabacce700c0a765ab662711b8adeb6dcb8f31f9ba6404196b03"}
Jul 02 23:35:24.015754 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:24.015224    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"
Jul 02 23:35:24.034111 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:24.034061    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5" podStartSLOduration=2.489011635 podStartE2EDuration="3.034046287s" totalImagesPullingTime="545.034652ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:24.032252753 +0000 UTC m=+1472.656671131" watchObservedRunningTime="2026-07-02 23:35:24.034046287 +0000 UTC m=+1472.658464663"
Jul 02 23:35:27.407763 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:27.407730    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"]
Jul 02 23:35:27.408251 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:27.407986    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5" podUID="21697822-c6f4-409b-b2a5-3bc210a20668" containerName="maas-api" containerID="cri-o://3d3f6aa34516aabacce700c0a765ab662711b8adeb6dcb8f31f9ba6404196b03" gracePeriod=30
Jul 02 23:35:27.648484 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:27.648445    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"
Jul 02 23:35:27.771197 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:27.771119    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21697822-c6f4-409b-b2a5-3bc210a20668-maas-api-tls\") pod \"21697822-c6f4-409b-b2a5-3bc210a20668\" (UID: \"21697822-c6f4-409b-b2a5-3bc210a20668\") "
Jul 02 23:35:27.771197 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:27.771164    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq2f5\" (UniqueName: \"kubernetes.io/projected/21697822-c6f4-409b-b2a5-3bc210a20668-kube-api-access-kq2f5\") pod \"21697822-c6f4-409b-b2a5-3bc210a20668\" (UID: \"21697822-c6f4-409b-b2a5-3bc210a20668\") "
Jul 02 23:35:27.771389 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:27.771203    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21697822-c6f4-409b-b2a5-3bc210a20668-openshift-service-ca\") pod \"21697822-c6f4-409b-b2a5-3bc210a20668\" (UID: \"21697822-c6f4-409b-b2a5-3bc210a20668\") "
Jul 02 23:35:27.771599 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:27.771565    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21697822-c6f4-409b-b2a5-3bc210a20668-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "21697822-c6f4-409b-b2a5-3bc210a20668" (UID: "21697822-c6f4-409b-b2a5-3bc210a20668"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:35:27.773185 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:27.773154    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21697822-c6f4-409b-b2a5-3bc210a20668-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "21697822-c6f4-409b-b2a5-3bc210a20668" (UID: "21697822-c6f4-409b-b2a5-3bc210a20668"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:35:27.773272 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:27.773250    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21697822-c6f4-409b-b2a5-3bc210a20668-kube-api-access-kq2f5" (OuterVolumeSpecName: "kube-api-access-kq2f5") pod "21697822-c6f4-409b-b2a5-3bc210a20668" (UID: "21697822-c6f4-409b-b2a5-3bc210a20668"). InnerVolumeSpecName "kube-api-access-kq2f5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:27.872403 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:27.872376    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21697822-c6f4-409b-b2a5-3bc210a20668-maas-api-tls\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:35:27.872403 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:27.872401    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq2f5\" (UniqueName: \"kubernetes.io/projected/21697822-c6f4-409b-b2a5-3bc210a20668-kube-api-access-kq2f5\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:35:27.872564 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:27.872410    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21697822-c6f4-409b-b2a5-3bc210a20668-openshift-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:35:28.034978 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:28.034892    2563 generic.go:356] "Generic (PLEG): container finished" podID="21697822-c6f4-409b-b2a5-3bc210a20668" containerID="3d3f6aa34516aabacce700c0a765ab662711b8adeb6dcb8f31f9ba6404196b03" exitCode=0
Jul 02 23:35:28.034978 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:28.034963    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"
Jul 02 23:35:28.034978 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:28.034969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5" event={"ID":"21697822-c6f4-409b-b2a5-3bc210a20668","Type":"ContainerDied","Data":"3d3f6aa34516aabacce700c0a765ab662711b8adeb6dcb8f31f9ba6404196b03"}
Jul 02 23:35:28.035211 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:28.035013    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5" event={"ID":"21697822-c6f4-409b-b2a5-3bc210a20668","Type":"ContainerDied","Data":"b8d8219a5e54b448b8d8ec2232e8ac839949a8b56994c0a20afd800b16e16172"}
Jul 02 23:35:28.035211 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:28.035037    2563 scope.go:117] "RemoveContainer" containerID="3d3f6aa34516aabacce700c0a765ab662711b8adeb6dcb8f31f9ba6404196b03"
Jul 02 23:35:28.043681 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:28.043661    2563 scope.go:117] "RemoveContainer" containerID="3d3f6aa34516aabacce700c0a765ab662711b8adeb6dcb8f31f9ba6404196b03"
Jul 02 23:35:28.043948 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:35:28.043912    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d3f6aa34516aabacce700c0a765ab662711b8adeb6dcb8f31f9ba6404196b03\": container with ID starting with 3d3f6aa34516aabacce700c0a765ab662711b8adeb6dcb8f31f9ba6404196b03 not found: ID does not exist" containerID="3d3f6aa34516aabacce700c0a765ab662711b8adeb6dcb8f31f9ba6404196b03"
Jul 02 23:35:28.044010 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:28.043956    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d3f6aa34516aabacce700c0a765ab662711b8adeb6dcb8f31f9ba6404196b03"} err="failed to get container status \"3d3f6aa34516aabacce700c0a765ab662711b8adeb6dcb8f31f9ba6404196b03\": rpc error: code = NotFound desc = could not find container \"3d3f6aa34516aabacce700c0a765ab662711b8adeb6dcb8f31f9ba6404196b03\": container with ID starting with 3d3f6aa34516aabacce700c0a765ab662711b8adeb6dcb8f31f9ba6404196b03 not found: ID does not exist"
Jul 02 23:35:28.051242 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:28.051224    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"]
Jul 02 23:35:28.057269 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:28.057249    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-cb663cc4-99475cb8d-fqlq5"]
Jul 02 23:35:29.886260 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:29.886216    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21697822-c6f4-409b-b2a5-3bc210a20668" path="/var/lib/kubelet/pods/21697822-c6f4-409b-b2a5-3bc210a20668/volumes"
Jul 02 23:35:34.518397 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.518362    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"]
Jul 02 23:35:34.518808 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.518786    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21697822-c6f4-409b-b2a5-3bc210a20668" containerName="maas-api"
Jul 02 23:35:34.518808 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.518799    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="21697822-c6f4-409b-b2a5-3bc210a20668" containerName="maas-api"
Jul 02 23:35:34.518882 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.518873    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="21697822-c6f4-409b-b2a5-3bc210a20668" containerName="maas-api"
Jul 02 23:35:34.523206 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.523188    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"
Jul 02 23:35:34.525722 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.525702    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-37f19217-serving-cert\""
Jul 02 23:35:34.533611 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.533586    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"]
Jul 02 23:35:34.625198 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.625166    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-openshift-service-ca\") pod \"maas-api-e2e-ait-37f19217-5596548fd4-cwxdf\" (UID: \"ac7b3271-9e1a-4bd0-902d-51bb9fafd008\") " pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"
Jul 02 23:35:34.625198 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.625204    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrvg8\" (UniqueName: \"kubernetes.io/projected/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-kube-api-access-nrvg8\") pod \"maas-api-e2e-ait-37f19217-5596548fd4-cwxdf\" (UID: \"ac7b3271-9e1a-4bd0-902d-51bb9fafd008\") " pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"
Jul 02 23:35:34.625404 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.625246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-maas-api-tls\") pod \"maas-api-e2e-ait-37f19217-5596548fd4-cwxdf\" (UID: \"ac7b3271-9e1a-4bd0-902d-51bb9fafd008\") " pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"
Jul 02 23:35:34.725832 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.725786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-openshift-service-ca\") pod \"maas-api-e2e-ait-37f19217-5596548fd4-cwxdf\" (UID: \"ac7b3271-9e1a-4bd0-902d-51bb9fafd008\") " pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"
Jul 02 23:35:34.725832 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.725836    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrvg8\" (UniqueName: \"kubernetes.io/projected/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-kube-api-access-nrvg8\") pod \"maas-api-e2e-ait-37f19217-5596548fd4-cwxdf\" (UID: \"ac7b3271-9e1a-4bd0-902d-51bb9fafd008\") " pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"
Jul 02 23:35:34.726114 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.725883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-maas-api-tls\") pod \"maas-api-e2e-ait-37f19217-5596548fd4-cwxdf\" (UID: \"ac7b3271-9e1a-4bd0-902d-51bb9fafd008\") " pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"
Jul 02 23:35:34.727953 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.726975    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-openshift-service-ca\") pod \"maas-api-e2e-ait-37f19217-5596548fd4-cwxdf\" (UID: \"ac7b3271-9e1a-4bd0-902d-51bb9fafd008\") " pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"
Jul 02 23:35:34.733356 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.733334    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-maas-api-tls\") pod \"maas-api-e2e-ait-37f19217-5596548fd4-cwxdf\" (UID: \"ac7b3271-9e1a-4bd0-902d-51bb9fafd008\") " pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"
Jul 02 23:35:34.735308 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.735289    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrvg8\" (UniqueName: \"kubernetes.io/projected/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-kube-api-access-nrvg8\") pod \"maas-api-e2e-ait-37f19217-5596548fd4-cwxdf\" (UID: \"ac7b3271-9e1a-4bd0-902d-51bb9fafd008\") " pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"
Jul 02 23:35:34.834910 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.834878    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"
Jul 02 23:35:34.969722 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:34.969702    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"]
Jul 02 23:35:34.972172 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:35:34.972134    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7b3271_9e1a_4bd0_902d_51bb9fafd008.slice/crio-3fd5629ed9df331668937ea054d8c713ecb4a7bf0ca1ce523587c79de4f0c22a WatchSource:0}: Error finding container 3fd5629ed9df331668937ea054d8c713ecb4a7bf0ca1ce523587c79de4f0c22a: Status 404 returned error can't find the container with id 3fd5629ed9df331668937ea054d8c713ecb4a7bf0ca1ce523587c79de4f0c22a
Jul 02 23:35:35.071414 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:35.071381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf" event={"ID":"ac7b3271-9e1a-4bd0-902d-51bb9fafd008","Type":"ContainerStarted","Data":"3fd5629ed9df331668937ea054d8c713ecb4a7bf0ca1ce523587c79de4f0c22a"}
Jul 02 23:35:36.078245 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:36.078202    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf" event={"ID":"ac7b3271-9e1a-4bd0-902d-51bb9fafd008","Type":"ContainerStarted","Data":"179dbfc6fbff46eb0595c398eeec4a8b289444066ff4f35351aaba20c35f99c6"}
Jul 02 23:35:36.078724 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:36.078331    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"
Jul 02 23:35:36.100969 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:36.100901    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf" podStartSLOduration=1.707386201 podStartE2EDuration="2.10088733s" totalImagesPullingTime="393.501129ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:36.099714883 +0000 UTC m=+1484.724133260" watchObservedRunningTime="2026-07-02 23:35:36.10088733 +0000 UTC m=+1484.725305705"
Jul 02 23:35:39.888776 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:39.888744    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"]
Jul 02 23:35:39.889261 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:39.888985    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf" podUID="ac7b3271-9e1a-4bd0-902d-51bb9fafd008" containerName="maas-api" containerID="cri-o://179dbfc6fbff46eb0595c398eeec4a8b289444066ff4f35351aaba20c35f99c6" gracePeriod=30
Jul 02 23:35:40.098646 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:40.098613    2563 generic.go:356] "Generic (PLEG): container finished" podID="ac7b3271-9e1a-4bd0-902d-51bb9fafd008" containerID="179dbfc6fbff46eb0595c398eeec4a8b289444066ff4f35351aaba20c35f99c6" exitCode=0
Jul 02 23:35:40.098801 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:40.098690    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf" event={"ID":"ac7b3271-9e1a-4bd0-902d-51bb9fafd008","Type":"ContainerDied","Data":"179dbfc6fbff46eb0595c398eeec4a8b289444066ff4f35351aaba20c35f99c6"}
Jul 02 23:35:40.131682 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:40.131662    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"
Jul 02 23:35:40.276734 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:40.276645    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-maas-api-tls\") pod \"ac7b3271-9e1a-4bd0-902d-51bb9fafd008\" (UID: \"ac7b3271-9e1a-4bd0-902d-51bb9fafd008\") "
Jul 02 23:35:40.276734 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:40.276716    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-openshift-service-ca\") pod \"ac7b3271-9e1a-4bd0-902d-51bb9fafd008\" (UID: \"ac7b3271-9e1a-4bd0-902d-51bb9fafd008\") "
Jul 02 23:35:40.276734 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:40.276734    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrvg8\" (UniqueName: \"kubernetes.io/projected/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-kube-api-access-nrvg8\") pod \"ac7b3271-9e1a-4bd0-902d-51bb9fafd008\" (UID: \"ac7b3271-9e1a-4bd0-902d-51bb9fafd008\") "
Jul 02 23:35:40.277128 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:40.277100    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ac7b3271-9e1a-4bd0-902d-51bb9fafd008" (UID: "ac7b3271-9e1a-4bd0-902d-51bb9fafd008"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:35:40.278762 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:40.278736    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ac7b3271-9e1a-4bd0-902d-51bb9fafd008" (UID: "ac7b3271-9e1a-4bd0-902d-51bb9fafd008"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:35:40.278828 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:40.278806    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-kube-api-access-nrvg8" (OuterVolumeSpecName: "kube-api-access-nrvg8") pod "ac7b3271-9e1a-4bd0-902d-51bb9fafd008" (UID: "ac7b3271-9e1a-4bd0-902d-51bb9fafd008"). InnerVolumeSpecName "kube-api-access-nrvg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:40.379246 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:40.378578    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-maas-api-tls\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:35:40.379246 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:40.378625    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-openshift-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:35:40.379246 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:40.378641    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrvg8\" (UniqueName: \"kubernetes.io/projected/ac7b3271-9e1a-4bd0-902d-51bb9fafd008-kube-api-access-nrvg8\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:35:41.105333 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:41.105297    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf" event={"ID":"ac7b3271-9e1a-4bd0-902d-51bb9fafd008","Type":"ContainerDied","Data":"3fd5629ed9df331668937ea054d8c713ecb4a7bf0ca1ce523587c79de4f0c22a"}
Jul 02 23:35:41.105333 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:41.105321    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"
Jul 02 23:35:41.105831 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:41.105358    2563 scope.go:117] "RemoveContainer" containerID="179dbfc6fbff46eb0595c398eeec4a8b289444066ff4f35351aaba20c35f99c6"
Jul 02 23:35:41.126390 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:41.126364    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"]
Jul 02 23:35:41.130404 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:41.130382    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-37f19217-5596548fd4-cwxdf"]
Jul 02 23:35:41.886597 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:41.886563    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac7b3271-9e1a-4bd0-902d-51bb9fafd008" path="/var/lib/kubelet/pods/ac7b3271-9e1a-4bd0-902d-51bb9fafd008/volumes"
Jul 02 23:35:51.876449 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:51.876419    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:35:51.885539 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:51.885499    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:35:52.906752 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:52.906718    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"]
Jul 02 23:35:52.907281 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:52.907234    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac7b3271-9e1a-4bd0-902d-51bb9fafd008" containerName="maas-api"
Jul 02 23:35:52.907281 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:52.907254    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac7b3271-9e1a-4bd0-902d-51bb9fafd008" containerName="maas-api"
Jul 02 23:35:52.907395 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:52.907376    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac7b3271-9e1a-4bd0-902d-51bb9fafd008" containerName="maas-api"
Jul 02 23:35:52.910207 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:52.910185    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"
Jul 02 23:35:52.913553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:52.913535    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-262e2828-serving-cert\""
Jul 02 23:35:52.925100 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:52.925071    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"]
Jul 02 23:35:53.087399 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:53.087369    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt55l\" (UniqueName: \"kubernetes.io/projected/8703a945-8d30-411c-b7c1-03e70d2f7d24-kube-api-access-tt55l\") pod \"maas-api-e2e-derive-262e2828-85c6b6494d-vg298\" (UID: \"8703a945-8d30-411c-b7c1-03e70d2f7d24\") " pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"
Jul 02 23:35:53.087594 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:53.087434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8703a945-8d30-411c-b7c1-03e70d2f7d24-maas-api-tls\") pod \"maas-api-e2e-derive-262e2828-85c6b6494d-vg298\" (UID: \"8703a945-8d30-411c-b7c1-03e70d2f7d24\") " pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"
Jul 02 23:35:53.087594 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:53.087512    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8703a945-8d30-411c-b7c1-03e70d2f7d24-openshift-service-ca\") pod \"maas-api-e2e-derive-262e2828-85c6b6494d-vg298\" (UID: \"8703a945-8d30-411c-b7c1-03e70d2f7d24\") " pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"
Jul 02 23:35:53.188967 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:53.188851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt55l\" (UniqueName: \"kubernetes.io/projected/8703a945-8d30-411c-b7c1-03e70d2f7d24-kube-api-access-tt55l\") pod \"maas-api-e2e-derive-262e2828-85c6b6494d-vg298\" (UID: \"8703a945-8d30-411c-b7c1-03e70d2f7d24\") " pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"
Jul 02 23:35:53.188967 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:53.188953    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8703a945-8d30-411c-b7c1-03e70d2f7d24-maas-api-tls\") pod \"maas-api-e2e-derive-262e2828-85c6b6494d-vg298\" (UID: \"8703a945-8d30-411c-b7c1-03e70d2f7d24\") " pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"
Jul 02 23:35:53.189221 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:53.188983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8703a945-8d30-411c-b7c1-03e70d2f7d24-openshift-service-ca\") pod \"maas-api-e2e-derive-262e2828-85c6b6494d-vg298\" (UID: \"8703a945-8d30-411c-b7c1-03e70d2f7d24\") " pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"
Jul 02 23:35:53.189221 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:35:53.189096    2563 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-262e2828-serving-cert: secret "maas-api-e2e-derive-262e2828-serving-cert" not found
Jul 02 23:35:53.189221 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:35:53.189164    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8703a945-8d30-411c-b7c1-03e70d2f7d24-maas-api-tls podName:8703a945-8d30-411c-b7c1-03e70d2f7d24 nodeName:}" failed. No retries permitted until 2026-07-02 23:35:53.689143331 +0000 UTC m=+1502.313561688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8703a945-8d30-411c-b7c1-03e70d2f7d24-maas-api-tls") pod "maas-api-e2e-derive-262e2828-85c6b6494d-vg298" (UID: "8703a945-8d30-411c-b7c1-03e70d2f7d24") : secret "maas-api-e2e-derive-262e2828-serving-cert" not found
Jul 02 23:35:53.189617 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:53.189600    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8703a945-8d30-411c-b7c1-03e70d2f7d24-openshift-service-ca\") pod \"maas-api-e2e-derive-262e2828-85c6b6494d-vg298\" (UID: \"8703a945-8d30-411c-b7c1-03e70d2f7d24\") " pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"
Jul 02 23:35:53.200434 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:53.200409    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt55l\" (UniqueName: \"kubernetes.io/projected/8703a945-8d30-411c-b7c1-03e70d2f7d24-kube-api-access-tt55l\") pod \"maas-api-e2e-derive-262e2828-85c6b6494d-vg298\" (UID: \"8703a945-8d30-411c-b7c1-03e70d2f7d24\") " pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"
Jul 02 23:35:53.692764 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:53.692726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8703a945-8d30-411c-b7c1-03e70d2f7d24-maas-api-tls\") pod \"maas-api-e2e-derive-262e2828-85c6b6494d-vg298\" (UID: \"8703a945-8d30-411c-b7c1-03e70d2f7d24\") " pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"
Jul 02 23:35:53.695325 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:53.695301    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8703a945-8d30-411c-b7c1-03e70d2f7d24-maas-api-tls\") pod \"maas-api-e2e-derive-262e2828-85c6b6494d-vg298\" (UID: \"8703a945-8d30-411c-b7c1-03e70d2f7d24\") " pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"
Jul 02 23:35:53.820784 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:53.820741    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"
Jul 02 23:35:53.957182 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:53.957158    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"]
Jul 02 23:35:53.959952 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:35:53.959909    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8703a945_8d30_411c_b7c1_03e70d2f7d24.slice/crio-4d16619df6d2618b46ae3caacd12414eef4ed1b5560ffcec58f5a0fe273d4b36 WatchSource:0}: Error finding container 4d16619df6d2618b46ae3caacd12414eef4ed1b5560ffcec58f5a0fe273d4b36: Status 404 returned error can't find the container with id 4d16619df6d2618b46ae3caacd12414eef4ed1b5560ffcec58f5a0fe273d4b36
Jul 02 23:35:54.170456 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:54.170425    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298" event={"ID":"8703a945-8d30-411c-b7c1-03e70d2f7d24","Type":"ContainerStarted","Data":"4d16619df6d2618b46ae3caacd12414eef4ed1b5560ffcec58f5a0fe273d4b36"}
Jul 02 23:35:55.176367 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:55.176327    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298" event={"ID":"8703a945-8d30-411c-b7c1-03e70d2f7d24","Type":"ContainerStarted","Data":"0be0aa9c3dde88eb0d15b2511714f02d4685e24e83b6f4fbf6430fccb77e20e9"}
Jul 02 23:35:55.176738 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:55.176398    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"
Jul 02 23:35:55.196076 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:55.196028    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298" podStartSLOduration=2.834551461 podStartE2EDuration="3.19601344s" totalImagesPullingTime="361.461979ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:55.19407555 +0000 UTC m=+1503.818493966" watchObservedRunningTime="2026-07-02 23:35:55.19601344 +0000 UTC m=+1503.820431815"
Jul 02 23:35:57.452690 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:57.452658    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"]
Jul 02 23:35:57.453110 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:57.452881    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298" podUID="8703a945-8d30-411c-b7c1-03e70d2f7d24" containerName="maas-api" containerID="cri-o://0be0aa9c3dde88eb0d15b2511714f02d4685e24e83b6f4fbf6430fccb77e20e9" gracePeriod=30
Jul 02 23:35:57.701882 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:57.701857    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"
Jul 02 23:35:57.828841 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:57.828737    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8703a945-8d30-411c-b7c1-03e70d2f7d24-maas-api-tls\") pod \"8703a945-8d30-411c-b7c1-03e70d2f7d24\" (UID: \"8703a945-8d30-411c-b7c1-03e70d2f7d24\") "
Jul 02 23:35:57.829052 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:57.828874    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt55l\" (UniqueName: \"kubernetes.io/projected/8703a945-8d30-411c-b7c1-03e70d2f7d24-kube-api-access-tt55l\") pod \"8703a945-8d30-411c-b7c1-03e70d2f7d24\" (UID: \"8703a945-8d30-411c-b7c1-03e70d2f7d24\") "
Jul 02 23:35:57.829052 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:57.828950    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8703a945-8d30-411c-b7c1-03e70d2f7d24-openshift-service-ca\") pod \"8703a945-8d30-411c-b7c1-03e70d2f7d24\" (UID: \"8703a945-8d30-411c-b7c1-03e70d2f7d24\") "
Jul 02 23:35:57.829324 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:57.829291    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8703a945-8d30-411c-b7c1-03e70d2f7d24-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8703a945-8d30-411c-b7c1-03e70d2f7d24" (UID: "8703a945-8d30-411c-b7c1-03e70d2f7d24"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:35:57.831022 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:57.830991    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8703a945-8d30-411c-b7c1-03e70d2f7d24-kube-api-access-tt55l" (OuterVolumeSpecName: "kube-api-access-tt55l") pod "8703a945-8d30-411c-b7c1-03e70d2f7d24" (UID: "8703a945-8d30-411c-b7c1-03e70d2f7d24"). InnerVolumeSpecName "kube-api-access-tt55l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:57.831128 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:57.831059    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8703a945-8d30-411c-b7c1-03e70d2f7d24-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8703a945-8d30-411c-b7c1-03e70d2f7d24" (UID: "8703a945-8d30-411c-b7c1-03e70d2f7d24"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:35:57.930406 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:57.930374    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt55l\" (UniqueName: \"kubernetes.io/projected/8703a945-8d30-411c-b7c1-03e70d2f7d24-kube-api-access-tt55l\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:35:57.930577 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:57.930407    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8703a945-8d30-411c-b7c1-03e70d2f7d24-openshift-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:35:57.930577 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:57.930426    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8703a945-8d30-411c-b7c1-03e70d2f7d24-maas-api-tls\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:35:58.192936 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:58.192831    2563 generic.go:356] "Generic (PLEG): container finished" podID="8703a945-8d30-411c-b7c1-03e70d2f7d24" containerID="0be0aa9c3dde88eb0d15b2511714f02d4685e24e83b6f4fbf6430fccb77e20e9" exitCode=0
Jul 02 23:35:58.192936 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:58.192879    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"
Jul 02 23:35:58.193146 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:58.192946    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298" event={"ID":"8703a945-8d30-411c-b7c1-03e70d2f7d24","Type":"ContainerDied","Data":"0be0aa9c3dde88eb0d15b2511714f02d4685e24e83b6f4fbf6430fccb77e20e9"}
Jul 02 23:35:58.193146 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:58.193000    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298" event={"ID":"8703a945-8d30-411c-b7c1-03e70d2f7d24","Type":"ContainerDied","Data":"4d16619df6d2618b46ae3caacd12414eef4ed1b5560ffcec58f5a0fe273d4b36"}
Jul 02 23:35:58.193146 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:58.193028    2563 scope.go:117] "RemoveContainer" containerID="0be0aa9c3dde88eb0d15b2511714f02d4685e24e83b6f4fbf6430fccb77e20e9"
Jul 02 23:35:58.201512 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:58.201494    2563 scope.go:117] "RemoveContainer" containerID="0be0aa9c3dde88eb0d15b2511714f02d4685e24e83b6f4fbf6430fccb77e20e9"
Jul 02 23:35:58.201777 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:35:58.201753    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0be0aa9c3dde88eb0d15b2511714f02d4685e24e83b6f4fbf6430fccb77e20e9\": container with ID starting with 0be0aa9c3dde88eb0d15b2511714f02d4685e24e83b6f4fbf6430fccb77e20e9 not found: ID does not exist" containerID="0be0aa9c3dde88eb0d15b2511714f02d4685e24e83b6f4fbf6430fccb77e20e9"
Jul 02 23:35:58.201845 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:58.201789    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0be0aa9c3dde88eb0d15b2511714f02d4685e24e83b6f4fbf6430fccb77e20e9"} err="failed to get container status \"0be0aa9c3dde88eb0d15b2511714f02d4685e24e83b6f4fbf6430fccb77e20e9\": rpc error: code = NotFound desc = could not find container \"0be0aa9c3dde88eb0d15b2511714f02d4685e24e83b6f4fbf6430fccb77e20e9\": container with ID starting with 0be0aa9c3dde88eb0d15b2511714f02d4685e24e83b6f4fbf6430fccb77e20e9 not found: ID does not exist"
Jul 02 23:35:58.209851 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:58.209829    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"]
Jul 02 23:35:58.213787 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:58.213766    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-262e2828-85c6b6494d-vg298"]
Jul 02 23:35:59.886173 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:35:59.886138    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8703a945-8d30-411c-b7c1-03e70d2f7d24" path="/var/lib/kubelet/pods/8703a945-8d30-411c-b7c1-03e70d2f7d24/volumes"
Jul 02 23:37:40.795636 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:40.795600    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"]
Jul 02 23:37:40.796155 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:40.796022    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8703a945-8d30-411c-b7c1-03e70d2f7d24" containerName="maas-api"
Jul 02 23:37:40.796155 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:40.796036    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8703a945-8d30-411c-b7c1-03e70d2f7d24" containerName="maas-api"
Jul 02 23:37:40.796155 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:40.796110    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8703a945-8d30-411c-b7c1-03e70d2f7d24" containerName="maas-api"
Jul 02 23:37:40.799226 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:40.799207    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:40.801820 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:40.801799    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-180069e8-serving-cert\""
Jul 02 23:37:40.809210 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:40.809183    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"]
Jul 02 23:37:40.892034 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:40.891999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-maas-api-tls\") pod \"maas-api-e2e-mt-180069e8-745d8fbfc8-256sl\" (UID: \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\") " pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:40.892220 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:40.892051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-openshift-service-ca\") pod \"maas-api-e2e-mt-180069e8-745d8fbfc8-256sl\" (UID: \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\") " pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:40.892220 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:40.892131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmhmc\" (UniqueName: \"kubernetes.io/projected/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-kube-api-access-kmhmc\") pod \"maas-api-e2e-mt-180069e8-745d8fbfc8-256sl\" (UID: \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\") " pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:40.992794 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:40.992753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-maas-api-tls\") pod \"maas-api-e2e-mt-180069e8-745d8fbfc8-256sl\" (UID: \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\") " pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:40.993034 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:40.992819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-openshift-service-ca\") pod \"maas-api-e2e-mt-180069e8-745d8fbfc8-256sl\" (UID: \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\") " pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:40.993034 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:40.992843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmhmc\" (UniqueName: \"kubernetes.io/projected/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-kube-api-access-kmhmc\") pod \"maas-api-e2e-mt-180069e8-745d8fbfc8-256sl\" (UID: \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\") " pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:40.993034 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:37:40.992885    2563 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-180069e8-serving-cert: secret "maas-api-e2e-mt-180069e8-serving-cert" not found
Jul 02 23:37:40.993034 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:37:40.992985    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-maas-api-tls podName:ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8 nodeName:}" failed. No retries permitted until 2026-07-02 23:37:41.492967199 +0000 UTC m=+1610.117385567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-maas-api-tls") pod "maas-api-e2e-mt-180069e8-745d8fbfc8-256sl" (UID: "ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8") : secret "maas-api-e2e-mt-180069e8-serving-cert" not found
Jul 02 23:37:40.993526 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:40.993503    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-openshift-service-ca\") pod \"maas-api-e2e-mt-180069e8-745d8fbfc8-256sl\" (UID: \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\") " pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:41.005781 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:41.005745    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmhmc\" (UniqueName: \"kubernetes.io/projected/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-kube-api-access-kmhmc\") pod \"maas-api-e2e-mt-180069e8-745d8fbfc8-256sl\" (UID: \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\") " pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:41.496220 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:41.496179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-maas-api-tls\") pod \"maas-api-e2e-mt-180069e8-745d8fbfc8-256sl\" (UID: \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\") " pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:41.498668 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:41.498645    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-maas-api-tls\") pod \"maas-api-e2e-mt-180069e8-745d8fbfc8-256sl\" (UID: \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\") " pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:41.709964 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:41.709897    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:41.858185 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:41.858147    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"]
Jul 02 23:37:41.859411 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:37:41.859382    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0553ae_7a1f_44f3_9f8a_c9be4c0d69a8.slice/crio-f9b604ea10c00104a65794193e9e59681539c81b6be6dcc78e36619eed1cb871 WatchSource:0}: Error finding container f9b604ea10c00104a65794193e9e59681539c81b6be6dcc78e36619eed1cb871: Status 404 returned error can't find the container with id f9b604ea10c00104a65794193e9e59681539c81b6be6dcc78e36619eed1cb871
Jul 02 23:37:42.681983 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:42.681947    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl" event={"ID":"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8","Type":"ContainerStarted","Data":"3caa5e8b803e65f0e2ee73c3423dd8a824593054e128abce1e2ea36c05eb2398"}
Jul 02 23:37:42.682182 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:42.682003    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl" event={"ID":"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8","Type":"ContainerStarted","Data":"f9b604ea10c00104a65794193e9e59681539c81b6be6dcc78e36619eed1cb871"}
Jul 02 23:37:42.682182 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:42.682044    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:42.720398 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:42.720346    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl" podStartSLOduration=2.319962137 podStartE2EDuration="2.720329209s" totalImagesPullingTime="400.367072ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:37:42.720104662 +0000 UTC m=+1611.344523037" watchObservedRunningTime="2026-07-02 23:37:42.720329209 +0000 UTC m=+1611.344747621"
Jul 02 23:37:48.692532 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:48.692503    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:52.981587 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:52.981549    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"]
Jul 02 23:37:52.982111 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:52.981776    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl" podUID="ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8" containerName="maas-api" containerID="cri-o://3caa5e8b803e65f0e2ee73c3423dd8a824593054e128abce1e2ea36c05eb2398" gracePeriod=30
Jul 02 23:37:53.228093 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.228070    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:53.296363 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.296274    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-maas-api-tls\") pod \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\" (UID: \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\") "
Jul 02 23:37:53.296363 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.296311    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-openshift-service-ca\") pod \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\" (UID: \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\") "
Jul 02 23:37:53.296363 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.296334    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmhmc\" (UniqueName: \"kubernetes.io/projected/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-kube-api-access-kmhmc\") pod \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\" (UID: \"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8\") "
Jul 02 23:37:53.296702 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.296676    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8" (UID: "ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:37:53.298429 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.298407    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8" (UID: "ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:37:53.298533 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.298512    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-kube-api-access-kmhmc" (OuterVolumeSpecName: "kube-api-access-kmhmc") pod "ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8" (UID: "ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8"). InnerVolumeSpecName "kube-api-access-kmhmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:37:53.397646 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.397607    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-maas-api-tls\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:37:53.397646 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.397639    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-openshift-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:37:53.397859 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.397655    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmhmc\" (UniqueName: \"kubernetes.io/projected/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8-kube-api-access-kmhmc\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:37:53.740988 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.740949    2563 generic.go:356] "Generic (PLEG): container finished" podID="ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8" containerID="3caa5e8b803e65f0e2ee73c3423dd8a824593054e128abce1e2ea36c05eb2398" exitCode=0
Jul 02 23:37:53.740988 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.740985    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"
Jul 02 23:37:53.741203 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.741023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl" event={"ID":"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8","Type":"ContainerDied","Data":"3caa5e8b803e65f0e2ee73c3423dd8a824593054e128abce1e2ea36c05eb2398"}
Jul 02 23:37:53.741203 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.741082    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl" event={"ID":"ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8","Type":"ContainerDied","Data":"f9b604ea10c00104a65794193e9e59681539c81b6be6dcc78e36619eed1cb871"}
Jul 02 23:37:53.741203 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.741105    2563 scope.go:117] "RemoveContainer" containerID="3caa5e8b803e65f0e2ee73c3423dd8a824593054e128abce1e2ea36c05eb2398"
Jul 02 23:37:53.750562 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.750547    2563 scope.go:117] "RemoveContainer" containerID="3caa5e8b803e65f0e2ee73c3423dd8a824593054e128abce1e2ea36c05eb2398"
Jul 02 23:37:53.750809 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:37:53.750793    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3caa5e8b803e65f0e2ee73c3423dd8a824593054e128abce1e2ea36c05eb2398\": container with ID starting with 3caa5e8b803e65f0e2ee73c3423dd8a824593054e128abce1e2ea36c05eb2398 not found: ID does not exist" containerID="3caa5e8b803e65f0e2ee73c3423dd8a824593054e128abce1e2ea36c05eb2398"
Jul 02 23:37:53.750863 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.750817    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3caa5e8b803e65f0e2ee73c3423dd8a824593054e128abce1e2ea36c05eb2398"} err="failed to get container status \"3caa5e8b803e65f0e2ee73c3423dd8a824593054e128abce1e2ea36c05eb2398\": rpc error: code = NotFound desc = could not find container \"3caa5e8b803e65f0e2ee73c3423dd8a824593054e128abce1e2ea36c05eb2398\": container with ID starting with 3caa5e8b803e65f0e2ee73c3423dd8a824593054e128abce1e2ea36c05eb2398 not found: ID does not exist"
Jul 02 23:37:53.763337 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.763306    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"]
Jul 02 23:37:53.766593 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.766569    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-180069e8-745d8fbfc8-256sl"]
Jul 02 23:37:53.885987 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:37:53.885954    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8" path="/var/lib/kubelet/pods/ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8/volumes"
Jul 02 23:38:20.918764 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:20.918732    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"]
Jul 02 23:38:20.919356 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:20.919280    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8" containerName="maas-api"
Jul 02 23:38:20.919356 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:20.919299    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8" containerName="maas-api"
Jul 02 23:38:20.919474 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:20.919383    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad0553ae-7a1f-44f3-9f8a-c9be4c0d69a8" containerName="maas-api"
Jul 02 23:38:20.923734 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:20.923716    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:20.926526 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:20.926508    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-bebb6de2-serving-cert\""
Jul 02 23:38:20.933208 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:20.933182    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"]
Jul 02 23:38:21.042154 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:21.042116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd26cb3-2c4c-4730-abee-9cd0f4893949-maas-api-tls\") pod \"maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48\" (UID: \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\") " pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:21.042356 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:21.042170    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd26cb3-2c4c-4730-abee-9cd0f4893949-openshift-service-ca\") pod \"maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48\" (UID: \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\") " pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:21.042356 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:21.042247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl8ql\" (UniqueName: \"kubernetes.io/projected/ffd26cb3-2c4c-4730-abee-9cd0f4893949-kube-api-access-gl8ql\") pod \"maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48\" (UID: \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\") " pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:21.142967 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:21.142929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl8ql\" (UniqueName: \"kubernetes.io/projected/ffd26cb3-2c4c-4730-abee-9cd0f4893949-kube-api-access-gl8ql\") pod \"maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48\" (UID: \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\") " pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:21.143133 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:21.143058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd26cb3-2c4c-4730-abee-9cd0f4893949-maas-api-tls\") pod \"maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48\" (UID: \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\") " pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:21.143133 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:21.143098    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd26cb3-2c4c-4730-abee-9cd0f4893949-openshift-service-ca\") pod \"maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48\" (UID: \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\") " pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:21.143251 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:38:21.143169    2563 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-bebb6de2-serving-cert: secret "maas-api-e2e-mt-bebb6de2-serving-cert" not found
Jul 02 23:38:21.143251 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:38:21.143246    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffd26cb3-2c4c-4730-abee-9cd0f4893949-maas-api-tls podName:ffd26cb3-2c4c-4730-abee-9cd0f4893949 nodeName:}" failed. No retries permitted until 2026-07-02 23:38:21.643222716 +0000 UTC m=+1650.267641092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ffd26cb3-2c4c-4730-abee-9cd0f4893949-maas-api-tls") pod "maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48" (UID: "ffd26cb3-2c4c-4730-abee-9cd0f4893949") : secret "maas-api-e2e-mt-bebb6de2-serving-cert" not found
Jul 02 23:38:21.143638 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:21.143619    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd26cb3-2c4c-4730-abee-9cd0f4893949-openshift-service-ca\") pod \"maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48\" (UID: \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\") " pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:21.161375 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:21.161339    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl8ql\" (UniqueName: \"kubernetes.io/projected/ffd26cb3-2c4c-4730-abee-9cd0f4893949-kube-api-access-gl8ql\") pod \"maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48\" (UID: \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\") " pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:21.647667 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:21.647625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd26cb3-2c4c-4730-abee-9cd0f4893949-maas-api-tls\") pod \"maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48\" (UID: \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\") " pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:21.650355 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:21.650320    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd26cb3-2c4c-4730-abee-9cd0f4893949-maas-api-tls\") pod \"maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48\" (UID: \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\") " pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:21.836106 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:21.836068    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:21.974871 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:21.974839    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"]
Jul 02 23:38:21.977452 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:38:21.977426    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd26cb3_2c4c_4730_abee_9cd0f4893949.slice/crio-97254000ea1c27a597a30f4293aee321870bcf15a13d93d5cfa816cec9ad0248 WatchSource:0}: Error finding container 97254000ea1c27a597a30f4293aee321870bcf15a13d93d5cfa816cec9ad0248: Status 404 returned error can't find the container with id 97254000ea1c27a597a30f4293aee321870bcf15a13d93d5cfa816cec9ad0248
Jul 02 23:38:22.885353 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:22.885318    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48" event={"ID":"ffd26cb3-2c4c-4730-abee-9cd0f4893949","Type":"ContainerStarted","Data":"4ad315b048b260ee8d9603f7f342e5e0240b02b4c52f698800b024cb1cf402c6"}
Jul 02 23:38:22.885529 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:22.885372    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:22.885529 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:22.885388    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48" event={"ID":"ffd26cb3-2c4c-4730-abee-9cd0f4893949","Type":"ContainerStarted","Data":"97254000ea1c27a597a30f4293aee321870bcf15a13d93d5cfa816cec9ad0248"}
Jul 02 23:38:22.905502 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:22.905453    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48" podStartSLOduration=2.602712255 podStartE2EDuration="2.905439362s" totalImagesPullingTime="302.727107ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:38:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:38:22.903443042 +0000 UTC m=+1651.527861421" watchObservedRunningTime="2026-07-02 23:38:22.905439362 +0000 UTC m=+1651.529857737"
Jul 02 23:38:28.896530 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:28.896500    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:58.632825 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:58.632778    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"]
Jul 02 23:38:58.633279 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:58.633049    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48" podUID="ffd26cb3-2c4c-4730-abee-9cd0f4893949" containerName="maas-api" containerID="cri-o://4ad315b048b260ee8d9603f7f342e5e0240b02b4c52f698800b024cb1cf402c6" gracePeriod=30
Jul 02 23:38:58.881189 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:58.881163    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:58.967032 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:58.966950    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd26cb3-2c4c-4730-abee-9cd0f4893949-openshift-service-ca\") pod \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\" (UID: \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\") "
Jul 02 23:38:58.967032 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:58.966990    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl8ql\" (UniqueName: \"kubernetes.io/projected/ffd26cb3-2c4c-4730-abee-9cd0f4893949-kube-api-access-gl8ql\") pod \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\" (UID: \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\") "
Jul 02 23:38:58.967032 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:58.967029    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd26cb3-2c4c-4730-abee-9cd0f4893949-maas-api-tls\") pod \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\" (UID: \"ffd26cb3-2c4c-4730-abee-9cd0f4893949\") "
Jul 02 23:38:58.967368 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:58.967336    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffd26cb3-2c4c-4730-abee-9cd0f4893949-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ffd26cb3-2c4c-4730-abee-9cd0f4893949" (UID: "ffd26cb3-2c4c-4730-abee-9cd0f4893949"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:38:58.969126 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:58.969094    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffd26cb3-2c4c-4730-abee-9cd0f4893949-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ffd26cb3-2c4c-4730-abee-9cd0f4893949" (UID: "ffd26cb3-2c4c-4730-abee-9cd0f4893949"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:38:58.969218 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:58.969160    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffd26cb3-2c4c-4730-abee-9cd0f4893949-kube-api-access-gl8ql" (OuterVolumeSpecName: "kube-api-access-gl8ql") pod "ffd26cb3-2c4c-4730-abee-9cd0f4893949" (UID: "ffd26cb3-2c4c-4730-abee-9cd0f4893949"). InnerVolumeSpecName "kube-api-access-gl8ql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:38:59.067811 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:59.067767    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffd26cb3-2c4c-4730-abee-9cd0f4893949-maas-api-tls\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:38:59.067811 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:59.067800    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd26cb3-2c4c-4730-abee-9cd0f4893949-openshift-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:38:59.067811 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:59.067811    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl8ql\" (UniqueName: \"kubernetes.io/projected/ffd26cb3-2c4c-4730-abee-9cd0f4893949-kube-api-access-gl8ql\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:38:59.073335 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:59.073303    2563 generic.go:356] "Generic (PLEG): container finished" podID="ffd26cb3-2c4c-4730-abee-9cd0f4893949" containerID="4ad315b048b260ee8d9603f7f342e5e0240b02b4c52f698800b024cb1cf402c6" exitCode=0
Jul 02 23:38:59.073505 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:59.073351    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"
Jul 02 23:38:59.073505 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:59.073391    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48" event={"ID":"ffd26cb3-2c4c-4730-abee-9cd0f4893949","Type":"ContainerDied","Data":"4ad315b048b260ee8d9603f7f342e5e0240b02b4c52f698800b024cb1cf402c6"}
Jul 02 23:38:59.073505 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:59.073454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48" event={"ID":"ffd26cb3-2c4c-4730-abee-9cd0f4893949","Type":"ContainerDied","Data":"97254000ea1c27a597a30f4293aee321870bcf15a13d93d5cfa816cec9ad0248"}
Jul 02 23:38:59.073505 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:59.073484    2563 scope.go:117] "RemoveContainer" containerID="4ad315b048b260ee8d9603f7f342e5e0240b02b4c52f698800b024cb1cf402c6"
Jul 02 23:38:59.082462 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:59.082444    2563 scope.go:117] "RemoveContainer" containerID="4ad315b048b260ee8d9603f7f342e5e0240b02b4c52f698800b024cb1cf402c6"
Jul 02 23:38:59.082698 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:38:59.082682    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ad315b048b260ee8d9603f7f342e5e0240b02b4c52f698800b024cb1cf402c6\": container with ID starting with 4ad315b048b260ee8d9603f7f342e5e0240b02b4c52f698800b024cb1cf402c6 not found: ID does not exist" containerID="4ad315b048b260ee8d9603f7f342e5e0240b02b4c52f698800b024cb1cf402c6"
Jul 02 23:38:59.082748 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:59.082706    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ad315b048b260ee8d9603f7f342e5e0240b02b4c52f698800b024cb1cf402c6"} err="failed to get container status \"4ad315b048b260ee8d9603f7f342e5e0240b02b4c52f698800b024cb1cf402c6\": rpc error: code = NotFound desc = could not find container \"4ad315b048b260ee8d9603f7f342e5e0240b02b4c52f698800b024cb1cf402c6\": container with ID starting with 4ad315b048b260ee8d9603f7f342e5e0240b02b4c52f698800b024cb1cf402c6 not found: ID does not exist"
Jul 02 23:38:59.095789 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:59.095760    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"]
Jul 02 23:38:59.101463 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:59.101439    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-bebb6de2-6c64cc6d6f-5qp48"]
Jul 02 23:38:59.886022 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:38:59.885990    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffd26cb3-2c4c-4730-abee-9cd0f4893949" path="/var/lib/kubelet/pods/ffd26cb3-2c4c-4730-abee-9cd0f4893949/volumes"
Jul 02 23:40:48.803255 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:48.803220    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"]
Jul 02 23:40:48.803653 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:48.803585    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffd26cb3-2c4c-4730-abee-9cd0f4893949" containerName="maas-api"
Jul 02 23:40:48.803653 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:48.803595    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffd26cb3-2c4c-4730-abee-9cd0f4893949" containerName="maas-api"
Jul 02 23:40:48.803653 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:48.803652    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffd26cb3-2c4c-4730-abee-9cd0f4893949" containerName="maas-api"
Jul 02 23:40:48.806659 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:48.806644    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:40:48.809270 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:48.809244    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-d73038-serving-cert\""
Jul 02 23:40:48.818074 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:48.818053    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"]
Jul 02 23:40:48.866128 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:48.866101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swppd\" (UniqueName: \"kubernetes.io/projected/03df7cf4-1a57-408c-9e3e-707abd2af6a8-kube-api-access-swppd\") pod \"maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx\" (UID: \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\") " pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:40:48.866283 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:48.866132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03df7cf4-1a57-408c-9e3e-707abd2af6a8-maas-api-tls\") pod \"maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx\" (UID: \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\") " pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:40:48.866283 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:48.866169    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03df7cf4-1a57-408c-9e3e-707abd2af6a8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx\" (UID: \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\") " pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:40:48.966784 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:48.966744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swppd\" (UniqueName: \"kubernetes.io/projected/03df7cf4-1a57-408c-9e3e-707abd2af6a8-kube-api-access-swppd\") pod \"maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx\" (UID: \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\") " pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:40:48.966784 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:48.966788    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03df7cf4-1a57-408c-9e3e-707abd2af6a8-maas-api-tls\") pod \"maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx\" (UID: \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\") " pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:40:48.967074 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:48.966831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03df7cf4-1a57-408c-9e3e-707abd2af6a8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx\" (UID: \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\") " pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:40:48.967074 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:40:48.966994    2563 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-d73038-serving-cert: secret "maas-api-e2e-inf-a-d73038-serving-cert" not found
Jul 02 23:40:48.967074 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:40:48.967075    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03df7cf4-1a57-408c-9e3e-707abd2af6a8-maas-api-tls podName:03df7cf4-1a57-408c-9e3e-707abd2af6a8 nodeName:}" failed. No retries permitted until 2026-07-02 23:40:49.467057038 +0000 UTC m=+1798.091475414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/03df7cf4-1a57-408c-9e3e-707abd2af6a8-maas-api-tls") pod "maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx" (UID: "03df7cf4-1a57-408c-9e3e-707abd2af6a8") : secret "maas-api-e2e-inf-a-d73038-serving-cert" not found
Jul 02 23:40:48.967606 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:48.967575    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03df7cf4-1a57-408c-9e3e-707abd2af6a8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx\" (UID: \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\") " pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:40:48.975854 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:48.975830    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swppd\" (UniqueName: \"kubernetes.io/projected/03df7cf4-1a57-408c-9e3e-707abd2af6a8-kube-api-access-swppd\") pod \"maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx\" (UID: \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\") " pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:40:49.470562 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:49.470529    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03df7cf4-1a57-408c-9e3e-707abd2af6a8-maas-api-tls\") pod \"maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx\" (UID: \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\") " pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:40:49.472751 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:49.472727    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03df7cf4-1a57-408c-9e3e-707abd2af6a8-maas-api-tls\") pod \"maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx\" (UID: \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\") " pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:40:49.717617 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:49.717533    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:40:49.853391 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:49.853366    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"]
Jul 02 23:40:49.855874 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:40:49.855846    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03df7cf4_1a57_408c_9e3e_707abd2af6a8.slice/crio-978ea51f745b74fa2c2cd8da7f53bd55af0671c332fa61cd918ef7b326820af6 WatchSource:0}: Error finding container 978ea51f745b74fa2c2cd8da7f53bd55af0671c332fa61cd918ef7b326820af6: Status 404 returned error can't find the container with id 978ea51f745b74fa2c2cd8da7f53bd55af0671c332fa61cd918ef7b326820af6
Jul 02 23:40:49.857353 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:49.857331    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:40:50.612427 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:50.612397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx" event={"ID":"03df7cf4-1a57-408c-9e3e-707abd2af6a8","Type":"ContainerStarted","Data":"4e88e5dbc31a343940b5dabcfa51b6961b8deebee320f675f252236d0976c504"}
Jul 02 23:40:50.612583 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:50.612448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx" event={"ID":"03df7cf4-1a57-408c-9e3e-707abd2af6a8","Type":"ContainerStarted","Data":"978ea51f745b74fa2c2cd8da7f53bd55af0671c332fa61cd918ef7b326820af6"}
Jul 02 23:40:50.612583 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:50.612487    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:40:50.630109 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:50.630067    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx" podStartSLOduration=2.051617627 podStartE2EDuration="2.630051661s" totalImagesPullingTime="578.434034ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:40:50.628457726 +0000 UTC m=+1799.252876102" watchObservedRunningTime="2026-07-02 23:40:50.630051661 +0000 UTC m=+1799.254470040"
Jul 02 23:40:51.909262 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:51.909234    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:40:51.922122 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:51.922095    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:40:56.622679 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:56.622646    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:40:56.705196 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:56.705164    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"]
Jul 02 23:40:56.708752 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:56.708729    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:40:56.711706 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:56.711685    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-8c4f9c-serving-cert\""
Jul 02 23:40:56.720343 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:56.720318    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"]
Jul 02 23:40:56.829551 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:56.829518    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-maas-api-tls\") pod \"maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl\" (UID: \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\") " pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:40:56.829689 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:56.829566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vndxp\" (UniqueName: \"kubernetes.io/projected/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-kube-api-access-vndxp\") pod \"maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl\" (UID: \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\") " pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:40:56.829689 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:56.829646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl\" (UID: \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\") " pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:40:56.930264 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:56.930175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-maas-api-tls\") pod \"maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl\" (UID: \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\") " pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:40:56.930264 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:56.930238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vndxp\" (UniqueName: \"kubernetes.io/projected/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-kube-api-access-vndxp\") pod \"maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl\" (UID: \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\") " pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:40:56.930482 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:56.930316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl\" (UID: \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\") " pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:40:56.930482 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:40:56.930330    2563 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-8c4f9c-serving-cert: secret "maas-api-e2e-inf-b-8c4f9c-serving-cert" not found
Jul 02 23:40:56.930482 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:40:56.930411    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-maas-api-tls podName:5a8479e4-5e15-49e2-a3aa-1b65447ef6fa nodeName:}" failed. No retries permitted until 2026-07-02 23:40:57.430392022 +0000 UTC m=+1806.054810404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-maas-api-tls") pod "maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl" (UID: "5a8479e4-5e15-49e2-a3aa-1b65447ef6fa") : secret "maas-api-e2e-inf-b-8c4f9c-serving-cert" not found
Jul 02 23:40:56.931008 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:56.930990    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl\" (UID: \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\") " pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:40:56.940162 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:56.940140    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vndxp\" (UniqueName: \"kubernetes.io/projected/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-kube-api-access-vndxp\") pod \"maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl\" (UID: \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\") " pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:40:57.435945 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:57.435896    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-maas-api-tls\") pod \"maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl\" (UID: \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\") " pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:40:57.438537 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:57.438507    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-maas-api-tls\") pod \"maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl\" (UID: \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\") " pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:40:57.621187 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:57.621153    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:40:57.751683 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:57.751660    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"]
Jul 02 23:40:57.754108 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:40:57.754081    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a8479e4_5e15_49e2_a3aa_1b65447ef6fa.slice/crio-6d633b0f3a46eb2abd3e7d1fa76d95f28ac8be136772f7390c8c80ef89c7f2d7 WatchSource:0}: Error finding container 6d633b0f3a46eb2abd3e7d1fa76d95f28ac8be136772f7390c8c80ef89c7f2d7: Status 404 returned error can't find the container with id 6d633b0f3a46eb2abd3e7d1fa76d95f28ac8be136772f7390c8c80ef89c7f2d7
Jul 02 23:40:58.652310 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:58.652268    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl" event={"ID":"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa","Type":"ContainerStarted","Data":"ac1517694422187d3ff63e1f76580a1278c3faefd55598288ead7a48b8222950"}
Jul 02 23:40:58.652466 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:58.652329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl" event={"ID":"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa","Type":"ContainerStarted","Data":"6d633b0f3a46eb2abd3e7d1fa76d95f28ac8be136772f7390c8c80ef89c7f2d7"}
Jul 02 23:40:58.652466 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:58.652353    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:40:58.673657 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:40:58.673606    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl" podStartSLOduration=2.319370224 podStartE2EDuration="2.673592215s" totalImagesPullingTime="354.221991ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:40:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:40:58.670908455 +0000 UTC m=+1807.295326831" watchObservedRunningTime="2026-07-02 23:40:58.673592215 +0000 UTC m=+1807.298010590"
Jul 02 23:41:04.663105 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:04.663073    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:41:51.094091 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.094060    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"]
Jul 02 23:41:51.094634 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.094270    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx" podUID="03df7cf4-1a57-408c-9e3e-707abd2af6a8" containerName="maas-api" containerID="cri-o://4e88e5dbc31a343940b5dabcfa51b6961b8deebee320f675f252236d0976c504" gracePeriod=30
Jul 02 23:41:51.341427 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.340886    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:41:51.389195 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.389112    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03df7cf4-1a57-408c-9e3e-707abd2af6a8-maas-api-tls\") pod \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\" (UID: \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\") "
Jul 02 23:41:51.389195 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.389143    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03df7cf4-1a57-408c-9e3e-707abd2af6a8-openshift-service-ca\") pod \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\" (UID: \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\") "
Jul 02 23:41:51.389417 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.389242    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swppd\" (UniqueName: \"kubernetes.io/projected/03df7cf4-1a57-408c-9e3e-707abd2af6a8-kube-api-access-swppd\") pod \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\" (UID: \"03df7cf4-1a57-408c-9e3e-707abd2af6a8\") "
Jul 02 23:41:51.389523 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.389499    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03df7cf4-1a57-408c-9e3e-707abd2af6a8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "03df7cf4-1a57-408c-9e3e-707abd2af6a8" (UID: "03df7cf4-1a57-408c-9e3e-707abd2af6a8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:41:51.391299 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.391269    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03df7cf4-1a57-408c-9e3e-707abd2af6a8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "03df7cf4-1a57-408c-9e3e-707abd2af6a8" (UID: "03df7cf4-1a57-408c-9e3e-707abd2af6a8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:41:51.391435 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.391307    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03df7cf4-1a57-408c-9e3e-707abd2af6a8-kube-api-access-swppd" (OuterVolumeSpecName: "kube-api-access-swppd") pod "03df7cf4-1a57-408c-9e3e-707abd2af6a8" (UID: "03df7cf4-1a57-408c-9e3e-707abd2af6a8"). InnerVolumeSpecName "kube-api-access-swppd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:41:51.490173 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.490146    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swppd\" (UniqueName: \"kubernetes.io/projected/03df7cf4-1a57-408c-9e3e-707abd2af6a8-kube-api-access-swppd\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:41:51.490173 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.490171    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03df7cf4-1a57-408c-9e3e-707abd2af6a8-maas-api-tls\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:41:51.490321 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.490180    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03df7cf4-1a57-408c-9e3e-707abd2af6a8-openshift-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:41:51.913137 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.913105    2563 generic.go:356] "Generic (PLEG): container finished" podID="03df7cf4-1a57-408c-9e3e-707abd2af6a8" containerID="4e88e5dbc31a343940b5dabcfa51b6961b8deebee320f675f252236d0976c504" exitCode=0
Jul 02 23:41:51.913319 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.913149    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"
Jul 02 23:41:51.913319 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.913191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx" event={"ID":"03df7cf4-1a57-408c-9e3e-707abd2af6a8","Type":"ContainerDied","Data":"4e88e5dbc31a343940b5dabcfa51b6961b8deebee320f675f252236d0976c504"}
Jul 02 23:41:51.913319 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.913242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx" event={"ID":"03df7cf4-1a57-408c-9e3e-707abd2af6a8","Type":"ContainerDied","Data":"978ea51f745b74fa2c2cd8da7f53bd55af0671c332fa61cd918ef7b326820af6"}
Jul 02 23:41:51.913319 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.913268    2563 scope.go:117] "RemoveContainer" containerID="4e88e5dbc31a343940b5dabcfa51b6961b8deebee320f675f252236d0976c504"
Jul 02 23:41:51.922382 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.922363    2563 scope.go:117] "RemoveContainer" containerID="4e88e5dbc31a343940b5dabcfa51b6961b8deebee320f675f252236d0976c504"
Jul 02 23:41:51.922663 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:41:51.922643    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e88e5dbc31a343940b5dabcfa51b6961b8deebee320f675f252236d0976c504\": container with ID starting with 4e88e5dbc31a343940b5dabcfa51b6961b8deebee320f675f252236d0976c504 not found: ID does not exist" containerID="4e88e5dbc31a343940b5dabcfa51b6961b8deebee320f675f252236d0976c504"
Jul 02 23:41:51.922713 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.922672    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e88e5dbc31a343940b5dabcfa51b6961b8deebee320f675f252236d0976c504"} err="failed to get container status \"4e88e5dbc31a343940b5dabcfa51b6961b8deebee320f675f252236d0976c504\": rpc error: code = NotFound desc = could not find container \"4e88e5dbc31a343940b5dabcfa51b6961b8deebee320f675f252236d0976c504\": container with ID starting with 4e88e5dbc31a343940b5dabcfa51b6961b8deebee320f675f252236d0976c504 not found: ID does not exist"
Jul 02 23:41:51.930147 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.930123    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"]
Jul 02 23:41:51.936026 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:51.936006    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-d73038-fdfdccd9b-bp9dx"]
Jul 02 23:41:53.885984 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:41:53.885954    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03df7cf4-1a57-408c-9e3e-707abd2af6a8" path="/var/lib/kubelet/pods/03df7cf4-1a57-408c-9e3e-707abd2af6a8/volumes"
Jul 02 23:42:09.250004 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.249957    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"]
Jul 02 23:42:09.250457 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.250165    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl" podUID="5a8479e4-5e15-49e2-a3aa-1b65447ef6fa" containerName="maas-api" containerID="cri-o://ac1517694422187d3ff63e1f76580a1278c3faefd55598288ead7a48b8222950" gracePeriod=30
Jul 02 23:42:09.491578 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.491556    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:42:09.540518 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.540450    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vndxp\" (UniqueName: \"kubernetes.io/projected/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-kube-api-access-vndxp\") pod \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\" (UID: \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\") "
Jul 02 23:42:09.540518 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.540491    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-maas-api-tls\") pod \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\" (UID: \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\") "
Jul 02 23:42:09.540720 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.540525    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-openshift-service-ca\") pod \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\" (UID: \"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa\") "
Jul 02 23:42:09.540931 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.540893    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5a8479e4-5e15-49e2-a3aa-1b65447ef6fa" (UID: "5a8479e4-5e15-49e2-a3aa-1b65447ef6fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:42:09.542517 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.542497    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5a8479e4-5e15-49e2-a3aa-1b65447ef6fa" (UID: "5a8479e4-5e15-49e2-a3aa-1b65447ef6fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:42:09.542597 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.542567    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-kube-api-access-vndxp" (OuterVolumeSpecName: "kube-api-access-vndxp") pod "5a8479e4-5e15-49e2-a3aa-1b65447ef6fa" (UID: "5a8479e4-5e15-49e2-a3aa-1b65447ef6fa"). InnerVolumeSpecName "kube-api-access-vndxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:42:09.642044 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.642015    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vndxp\" (UniqueName: \"kubernetes.io/projected/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-kube-api-access-vndxp\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:42:09.642044 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.642042    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-maas-api-tls\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:42:09.642044 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.642051    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa-openshift-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:42:09.998506 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.998470    2563 generic.go:356] "Generic (PLEG): container finished" podID="5a8479e4-5e15-49e2-a3aa-1b65447ef6fa" containerID="ac1517694422187d3ff63e1f76580a1278c3faefd55598288ead7a48b8222950" exitCode=0
Jul 02 23:42:09.998669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.998516    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"
Jul 02 23:42:09.998669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.998546    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl" event={"ID":"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa","Type":"ContainerDied","Data":"ac1517694422187d3ff63e1f76580a1278c3faefd55598288ead7a48b8222950"}
Jul 02 23:42:09.998669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.998602    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl" event={"ID":"5a8479e4-5e15-49e2-a3aa-1b65447ef6fa","Type":"ContainerDied","Data":"6d633b0f3a46eb2abd3e7d1fa76d95f28ac8be136772f7390c8c80ef89c7f2d7"}
Jul 02 23:42:09.998669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:09.998617    2563 scope.go:117] "RemoveContainer" containerID="ac1517694422187d3ff63e1f76580a1278c3faefd55598288ead7a48b8222950"
Jul 02 23:42:10.007249 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:10.007232    2563 scope.go:117] "RemoveContainer" containerID="ac1517694422187d3ff63e1f76580a1278c3faefd55598288ead7a48b8222950"
Jul 02 23:42:10.007516 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:42:10.007497    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac1517694422187d3ff63e1f76580a1278c3faefd55598288ead7a48b8222950\": container with ID starting with ac1517694422187d3ff63e1f76580a1278c3faefd55598288ead7a48b8222950 not found: ID does not exist" containerID="ac1517694422187d3ff63e1f76580a1278c3faefd55598288ead7a48b8222950"
Jul 02 23:42:10.007558 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:10.007524    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac1517694422187d3ff63e1f76580a1278c3faefd55598288ead7a48b8222950"} err="failed to get container status \"ac1517694422187d3ff63e1f76580a1278c3faefd55598288ead7a48b8222950\": rpc error: code = NotFound desc = could not find container \"ac1517694422187d3ff63e1f76580a1278c3faefd55598288ead7a48b8222950\": container with ID starting with ac1517694422187d3ff63e1f76580a1278c3faefd55598288ead7a48b8222950 not found: ID does not exist"
Jul 02 23:42:10.015589 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:10.015568    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"]
Jul 02 23:42:10.019710 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:10.019691    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-8c4f9c-7fb8f7c5f5-xz8xl"]
Jul 02 23:42:11.886684 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:11.886648    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a8479e4-5e15-49e2-a3aa-1b65447ef6fa" path="/var/lib/kubelet/pods/5a8479e4-5e15-49e2-a3aa-1b65447ef6fa/volumes"
Jul 02 23:42:19.339270 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.339195    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"]
Jul 02 23:42:19.339665 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.339530    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a8479e4-5e15-49e2-a3aa-1b65447ef6fa" containerName="maas-api"
Jul 02 23:42:19.339665 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.339541    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a8479e4-5e15-49e2-a3aa-1b65447ef6fa" containerName="maas-api"
Jul 02 23:42:19.339665 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.339549    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03df7cf4-1a57-408c-9e3e-707abd2af6a8" containerName="maas-api"
Jul 02 23:42:19.339665 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.339555    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03df7cf4-1a57-408c-9e3e-707abd2af6a8" containerName="maas-api"
Jul 02 23:42:19.339665 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.339620    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a8479e4-5e15-49e2-a3aa-1b65447ef6fa" containerName="maas-api"
Jul 02 23:42:19.339665 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.339628    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="03df7cf4-1a57-408c-9e3e-707abd2af6a8" containerName="maas-api"
Jul 02 23:42:19.343965 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.343945    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:19.346487 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.346464    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-79bbe8-serving-cert\""
Jul 02 23:42:19.356586 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.356560    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"]
Jul 02 23:42:19.422136 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.422106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f644802-fb5d-4e64-97cc-7ed2fe315d88-openshift-service-ca\") pod \"maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8\" (UID: \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\") " pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:19.422315 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.422156    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f644802-fb5d-4e64-97cc-7ed2fe315d88-maas-api-tls\") pod \"maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8\" (UID: \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\") " pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:19.422315 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.422244    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ktw5\" (UniqueName: \"kubernetes.io/projected/6f644802-fb5d-4e64-97cc-7ed2fe315d88-kube-api-access-4ktw5\") pod \"maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8\" (UID: \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\") " pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:19.523446 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.523412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ktw5\" (UniqueName: \"kubernetes.io/projected/6f644802-fb5d-4e64-97cc-7ed2fe315d88-kube-api-access-4ktw5\") pod \"maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8\" (UID: \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\") " pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:19.523631 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.523452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f644802-fb5d-4e64-97cc-7ed2fe315d88-openshift-service-ca\") pod \"maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8\" (UID: \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\") " pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:19.523631 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.523489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f644802-fb5d-4e64-97cc-7ed2fe315d88-maas-api-tls\") pod \"maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8\" (UID: \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\") " pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:19.523631 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:42:19.523583    2563 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-79bbe8-serving-cert: secret "maas-api-e2e-api-a-79bbe8-serving-cert" not found
Jul 02 23:42:19.523744 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:42:19.523635    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f644802-fb5d-4e64-97cc-7ed2fe315d88-maas-api-tls podName:6f644802-fb5d-4e64-97cc-7ed2fe315d88 nodeName:}" failed. No retries permitted until 2026-07-02 23:42:20.023618638 +0000 UTC m=+1888.648036992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6f644802-fb5d-4e64-97cc-7ed2fe315d88-maas-api-tls") pod "maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8" (UID: "6f644802-fb5d-4e64-97cc-7ed2fe315d88") : secret "maas-api-e2e-api-a-79bbe8-serving-cert" not found
Jul 02 23:42:19.524209 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.524191    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f644802-fb5d-4e64-97cc-7ed2fe315d88-openshift-service-ca\") pod \"maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8\" (UID: \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\") " pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:19.533181 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:19.533160    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ktw5\" (UniqueName: \"kubernetes.io/projected/6f644802-fb5d-4e64-97cc-7ed2fe315d88-kube-api-access-4ktw5\") pod \"maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8\" (UID: \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\") " pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:20.027838 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:20.027804    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f644802-fb5d-4e64-97cc-7ed2fe315d88-maas-api-tls\") pod \"maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8\" (UID: \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\") " pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:20.030253 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:20.030226    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f644802-fb5d-4e64-97cc-7ed2fe315d88-maas-api-tls\") pod \"maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8\" (UID: \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\") " pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:20.255265 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:20.255229    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:20.392265 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:20.392237    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"]
Jul 02 23:42:20.394332 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:42:20.394302    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f644802_fb5d_4e64_97cc_7ed2fe315d88.slice/crio-2d36804e0a6276966b904d1384e03146b2ce0b1a21ed29ff2314ef2a56f9f46a WatchSource:0}: Error finding container 2d36804e0a6276966b904d1384e03146b2ce0b1a21ed29ff2314ef2a56f9f46a: Status 404 returned error can't find the container with id 2d36804e0a6276966b904d1384e03146b2ce0b1a21ed29ff2314ef2a56f9f46a
Jul 02 23:42:21.060097 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:21.060000    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8" event={"ID":"6f644802-fb5d-4e64-97cc-7ed2fe315d88","Type":"ContainerStarted","Data":"cbcd63bb91c4a063fc616a41a86c2b97540d9ddf51843a84f0a17c13fd9c1be1"}
Jul 02 23:42:21.060097 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:21.060063    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:21.060097 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:21.060079    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8" event={"ID":"6f644802-fb5d-4e64-97cc-7ed2fe315d88","Type":"ContainerStarted","Data":"2d36804e0a6276966b904d1384e03146b2ce0b1a21ed29ff2314ef2a56f9f46a"}
Jul 02 23:42:21.087452 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:21.087404    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8" podStartSLOduration=1.695452068 podStartE2EDuration="2.087388088s" totalImagesPullingTime="391.93602ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:42:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:42:21.086258095 +0000 UTC m=+1889.710676472" watchObservedRunningTime="2026-07-02 23:42:21.087388088 +0000 UTC m=+1889.711806463"
Jul 02 23:42:27.070068 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.070040    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:27.305378 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.305347    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"]
Jul 02 23:42:27.308837 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.308816    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"
Jul 02 23:42:27.312717 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.312694    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-9ce355-serving-cert\""
Jul 02 23:42:27.324364 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.324303    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"]
Jul 02 23:42:27.389322 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.389287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw8pg\" (UniqueName: \"kubernetes.io/projected/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-kube-api-access-sw8pg\") pod \"maas-api-e2e-api-b-9ce355-8498575c6c-npll5\" (UID: \"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47\") " pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"
Jul 02 23:42:27.389322 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.389325    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-openshift-service-ca\") pod \"maas-api-e2e-api-b-9ce355-8498575c6c-npll5\" (UID: \"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47\") " pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"
Jul 02 23:42:27.389532 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.389437    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-maas-api-tls\") pod \"maas-api-e2e-api-b-9ce355-8498575c6c-npll5\" (UID: \"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47\") " pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"
Jul 02 23:42:27.490551 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.490508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw8pg\" (UniqueName: \"kubernetes.io/projected/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-kube-api-access-sw8pg\") pod \"maas-api-e2e-api-b-9ce355-8498575c6c-npll5\" (UID: \"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47\") " pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"
Jul 02 23:42:27.490738 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.490562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-openshift-service-ca\") pod \"maas-api-e2e-api-b-9ce355-8498575c6c-npll5\" (UID: \"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47\") " pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"
Jul 02 23:42:27.490738 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.490667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-maas-api-tls\") pod \"maas-api-e2e-api-b-9ce355-8498575c6c-npll5\" (UID: \"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47\") " pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"
Jul 02 23:42:27.491573 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.491531    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-openshift-service-ca\") pod \"maas-api-e2e-api-b-9ce355-8498575c6c-npll5\" (UID: \"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47\") " pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"
Jul 02 23:42:27.493665 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.493639    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-maas-api-tls\") pod \"maas-api-e2e-api-b-9ce355-8498575c6c-npll5\" (UID: \"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47\") " pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"
Jul 02 23:42:27.502291 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.502245    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw8pg\" (UniqueName: \"kubernetes.io/projected/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-kube-api-access-sw8pg\") pod \"maas-api-e2e-api-b-9ce355-8498575c6c-npll5\" (UID: \"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47\") " pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"
Jul 02 23:42:27.619525 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.619494    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"
Jul 02 23:42:27.772725 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:27.772702    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"]
Jul 02 23:42:27.774370 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:42:27.774343    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d6e67b_e2a0_4d18_b3e3_cdd03ee89e47.slice/crio-93d7189c11059d43c010dc6dd37c224b2d0d43ffcfe1f54c44f992cf937ce0c6 WatchSource:0}: Error finding container 93d7189c11059d43c010dc6dd37c224b2d0d43ffcfe1f54c44f992cf937ce0c6: Status 404 returned error can't find the container with id 93d7189c11059d43c010dc6dd37c224b2d0d43ffcfe1f54c44f992cf937ce0c6
Jul 02 23:42:28.093127 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:28.093094    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5" event={"ID":"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47","Type":"ContainerStarted","Data":"93d7189c11059d43c010dc6dd37c224b2d0d43ffcfe1f54c44f992cf937ce0c6"}
Jul 02 23:42:29.099720 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:29.099684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5" event={"ID":"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47","Type":"ContainerStarted","Data":"fdbb5237c01d7ef87a9d7075f771aee7203f5ffd9cd0f178fdfe2e238207866d"}
Jul 02 23:42:29.100144 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:29.099814    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"
Jul 02 23:42:29.120340 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:29.120290    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5" podStartSLOduration=1.7756824089999999 podStartE2EDuration="2.120273724s" totalImagesPullingTime="344.591315ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:42:29.118808499 +0000 UTC m=+1897.743226875" watchObservedRunningTime="2026-07-02 23:42:29.120273724 +0000 UTC m=+1897.744692100"
Jul 02 23:42:35.110106 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:35.110072    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"
Jul 02 23:42:40.421759 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:40.421721    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"]
Jul 02 23:42:40.422240 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:40.422025    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8" podUID="6f644802-fb5d-4e64-97cc-7ed2fe315d88" containerName="maas-api" containerID="cri-o://cbcd63bb91c4a063fc616a41a86c2b97540d9ddf51843a84f0a17c13fd9c1be1" gracePeriod=30
Jul 02 23:42:40.676676 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:40.676607    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:40.812753 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:40.812721    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f644802-fb5d-4e64-97cc-7ed2fe315d88-openshift-service-ca\") pod \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\" (UID: \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\") "
Jul 02 23:42:40.812949 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:40.812769    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f644802-fb5d-4e64-97cc-7ed2fe315d88-maas-api-tls\") pod \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\" (UID: \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\") "
Jul 02 23:42:40.812949 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:40.812821    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ktw5\" (UniqueName: \"kubernetes.io/projected/6f644802-fb5d-4e64-97cc-7ed2fe315d88-kube-api-access-4ktw5\") pod \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\" (UID: \"6f644802-fb5d-4e64-97cc-7ed2fe315d88\") "
Jul 02 23:42:40.813365 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:40.813327    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f644802-fb5d-4e64-97cc-7ed2fe315d88-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6f644802-fb5d-4e64-97cc-7ed2fe315d88" (UID: "6f644802-fb5d-4e64-97cc-7ed2fe315d88"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:42:40.815199 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:40.815172    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f644802-fb5d-4e64-97cc-7ed2fe315d88-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6f644802-fb5d-4e64-97cc-7ed2fe315d88" (UID: "6f644802-fb5d-4e64-97cc-7ed2fe315d88"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:42:40.815416 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:40.815390    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f644802-fb5d-4e64-97cc-7ed2fe315d88-kube-api-access-4ktw5" (OuterVolumeSpecName: "kube-api-access-4ktw5") pod "6f644802-fb5d-4e64-97cc-7ed2fe315d88" (UID: "6f644802-fb5d-4e64-97cc-7ed2fe315d88"). InnerVolumeSpecName "kube-api-access-4ktw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:42:40.914070 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:40.914029    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ktw5\" (UniqueName: \"kubernetes.io/projected/6f644802-fb5d-4e64-97cc-7ed2fe315d88-kube-api-access-4ktw5\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:42:40.914070 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:40.914062    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f644802-fb5d-4e64-97cc-7ed2fe315d88-openshift-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:42:40.914070 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:40.914071    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f644802-fb5d-4e64-97cc-7ed2fe315d88-maas-api-tls\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:42:41.165705 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:41.165668    2563 generic.go:356] "Generic (PLEG): container finished" podID="6f644802-fb5d-4e64-97cc-7ed2fe315d88" containerID="cbcd63bb91c4a063fc616a41a86c2b97540d9ddf51843a84f0a17c13fd9c1be1" exitCode=0
Jul 02 23:42:41.165902 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:41.165733    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"
Jul 02 23:42:41.165902 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:41.165743    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8" event={"ID":"6f644802-fb5d-4e64-97cc-7ed2fe315d88","Type":"ContainerDied","Data":"cbcd63bb91c4a063fc616a41a86c2b97540d9ddf51843a84f0a17c13fd9c1be1"}
Jul 02 23:42:41.165902 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:41.165828    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8" event={"ID":"6f644802-fb5d-4e64-97cc-7ed2fe315d88","Type":"ContainerDied","Data":"2d36804e0a6276966b904d1384e03146b2ce0b1a21ed29ff2314ef2a56f9f46a"}
Jul 02 23:42:41.165902 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:41.165852    2563 scope.go:117] "RemoveContainer" containerID="cbcd63bb91c4a063fc616a41a86c2b97540d9ddf51843a84f0a17c13fd9c1be1"
Jul 02 23:42:41.174861 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:41.174840    2563 scope.go:117] "RemoveContainer" containerID="cbcd63bb91c4a063fc616a41a86c2b97540d9ddf51843a84f0a17c13fd9c1be1"
Jul 02 23:42:41.175141 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:42:41.175122    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbcd63bb91c4a063fc616a41a86c2b97540d9ddf51843a84f0a17c13fd9c1be1\": container with ID starting with cbcd63bb91c4a063fc616a41a86c2b97540d9ddf51843a84f0a17c13fd9c1be1 not found: ID does not exist" containerID="cbcd63bb91c4a063fc616a41a86c2b97540d9ddf51843a84f0a17c13fd9c1be1"
Jul 02 23:42:41.175203 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:41.175150    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbcd63bb91c4a063fc616a41a86c2b97540d9ddf51843a84f0a17c13fd9c1be1"} err="failed to get container status \"cbcd63bb91c4a063fc616a41a86c2b97540d9ddf51843a84f0a17c13fd9c1be1\": rpc error: code = NotFound desc = could not find container \"cbcd63bb91c4a063fc616a41a86c2b97540d9ddf51843a84f0a17c13fd9c1be1\": container with ID starting with cbcd63bb91c4a063fc616a41a86c2b97540d9ddf51843a84f0a17c13fd9c1be1 not found: ID does not exist"
Jul 02 23:42:41.186761 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:41.186730    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"]
Jul 02 23:42:41.190644 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:41.190619    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-79bbe8-788b78b599-v4hh8"]
Jul 02 23:42:41.886100 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:41.886070    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f644802-fb5d-4e64-97cc-7ed2fe315d88" path="/var/lib/kubelet/pods/6f644802-fb5d-4e64-97cc-7ed2fe315d88/volumes"
Jul 02 23:42:47.455567 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:47.455530    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"]
Jul 02 23:42:47.456071 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:47.455836    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5" podUID="71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47" containerName="maas-api" containerID="cri-o://fdbb5237c01d7ef87a9d7075f771aee7203f5ffd9cd0f178fdfe2e238207866d" gracePeriod=30
Jul 02 23:42:47.700191 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:47.700162    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"
Jul 02 23:42:47.773854 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:47.773774    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-openshift-service-ca\") pod \"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47\" (UID: \"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47\") "
Jul 02 23:42:47.773854 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:47.773815    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-maas-api-tls\") pod \"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47\" (UID: \"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47\") "
Jul 02 23:42:47.774074 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:47.773858    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw8pg\" (UniqueName: \"kubernetes.io/projected/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-kube-api-access-sw8pg\") pod \"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47\" (UID: \"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47\") "
Jul 02 23:42:47.774162 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:47.774140    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47" (UID: "71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:42:47.775887 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:47.775858    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47" (UID: "71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:42:47.776022 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:47.775960    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-kube-api-access-sw8pg" (OuterVolumeSpecName: "kube-api-access-sw8pg") pod "71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47" (UID: "71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47"). InnerVolumeSpecName "kube-api-access-sw8pg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:42:47.874891 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:47.874850    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sw8pg\" (UniqueName: \"kubernetes.io/projected/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-kube-api-access-sw8pg\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:42:47.874891 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:47.874881    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-openshift-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:42:47.874891 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:47.874894    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47-maas-api-tls\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:42:48.201126 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:48.201094    2563 generic.go:356] "Generic (PLEG): container finished" podID="71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47" containerID="fdbb5237c01d7ef87a9d7075f771aee7203f5ffd9cd0f178fdfe2e238207866d" exitCode=0
Jul 02 23:42:48.201306 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:48.201140    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"
Jul 02 23:42:48.201306 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:48.201147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5" event={"ID":"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47","Type":"ContainerDied","Data":"fdbb5237c01d7ef87a9d7075f771aee7203f5ffd9cd0f178fdfe2e238207866d"}
Jul 02 23:42:48.201306 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:48.201193    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5" event={"ID":"71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47","Type":"ContainerDied","Data":"93d7189c11059d43c010dc6dd37c224b2d0d43ffcfe1f54c44f992cf937ce0c6"}
Jul 02 23:42:48.201306 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:48.201216    2563 scope.go:117] "RemoveContainer" containerID="fdbb5237c01d7ef87a9d7075f771aee7203f5ffd9cd0f178fdfe2e238207866d"
Jul 02 23:42:48.210043 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:48.210023    2563 scope.go:117] "RemoveContainer" containerID="fdbb5237c01d7ef87a9d7075f771aee7203f5ffd9cd0f178fdfe2e238207866d"
Jul 02 23:42:48.210299 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:42:48.210279    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdbb5237c01d7ef87a9d7075f771aee7203f5ffd9cd0f178fdfe2e238207866d\": container with ID starting with fdbb5237c01d7ef87a9d7075f771aee7203f5ffd9cd0f178fdfe2e238207866d not found: ID does not exist" containerID="fdbb5237c01d7ef87a9d7075f771aee7203f5ffd9cd0f178fdfe2e238207866d"
Jul 02 23:42:48.210360 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:48.210310    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdbb5237c01d7ef87a9d7075f771aee7203f5ffd9cd0f178fdfe2e238207866d"} err="failed to get container status \"fdbb5237c01d7ef87a9d7075f771aee7203f5ffd9cd0f178fdfe2e238207866d\": rpc error: code = NotFound desc = could not find container \"fdbb5237c01d7ef87a9d7075f771aee7203f5ffd9cd0f178fdfe2e238207866d\": container with ID starting with fdbb5237c01d7ef87a9d7075f771aee7203f5ffd9cd0f178fdfe2e238207866d not found: ID does not exist"
Jul 02 23:42:48.217779 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:48.217743    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"]
Jul 02 23:42:48.219793 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:48.219769    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-9ce355-8498575c6c-npll5"]
Jul 02 23:42:49.886560 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:49.886524    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47" path="/var/lib/kubelet/pods/71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47/volumes"
Jul 02 23:42:57.356058 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.356020    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"]
Jul 02 23:42:57.356542 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.356520    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f644802-fb5d-4e64-97cc-7ed2fe315d88" containerName="maas-api"
Jul 02 23:42:57.356615 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.356546    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f644802-fb5d-4e64-97cc-7ed2fe315d88" containerName="maas-api"
Jul 02 23:42:57.356615 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.356588    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47" containerName="maas-api"
Jul 02 23:42:57.356615 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.356597    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47" containerName="maas-api"
Jul 02 23:42:57.356760 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.356685    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f644802-fb5d-4e64-97cc-7ed2fe315d88" containerName="maas-api"
Jul 02 23:42:57.356760 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.356698    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="71d6e67b-e2a0-4d18-b3e3-cdd03ee89e47" containerName="maas-api"
Jul 02 23:42:57.359857 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.359837    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"
Jul 02 23:42:57.362564 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.362545    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-9d43a8-serving-cert\""
Jul 02 23:42:57.371428 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.371405    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"]
Jul 02 23:42:57.451435 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.451406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts2bx\" (UniqueName: \"kubernetes.io/projected/48e6aacc-fe74-403d-b4c1-e76379e0e214-kube-api-access-ts2bx\") pod \"maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn\" (UID: \"48e6aacc-fe74-403d-b4c1-e76379e0e214\") " pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"
Jul 02 23:42:57.451583 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.451443    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48e6aacc-fe74-403d-b4c1-e76379e0e214-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn\" (UID: \"48e6aacc-fe74-403d-b4c1-e76379e0e214\") " pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"
Jul 02 23:42:57.451583 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.451463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48e6aacc-fe74-403d-b4c1-e76379e0e214-maas-api-tls\") pod \"maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn\" (UID: \"48e6aacc-fe74-403d-b4c1-e76379e0e214\") " pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"
Jul 02 23:42:57.552317 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.552284    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts2bx\" (UniqueName: \"kubernetes.io/projected/48e6aacc-fe74-403d-b4c1-e76379e0e214-kube-api-access-ts2bx\") pod \"maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn\" (UID: \"48e6aacc-fe74-403d-b4c1-e76379e0e214\") " pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"
Jul 02 23:42:57.552460 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.552325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48e6aacc-fe74-403d-b4c1-e76379e0e214-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn\" (UID: \"48e6aacc-fe74-403d-b4c1-e76379e0e214\") " pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"
Jul 02 23:42:57.552460 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.552345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48e6aacc-fe74-403d-b4c1-e76379e0e214-maas-api-tls\") pod \"maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn\" (UID: \"48e6aacc-fe74-403d-b4c1-e76379e0e214\") " pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"
Jul 02 23:42:57.553001 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.552979    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48e6aacc-fe74-403d-b4c1-e76379e0e214-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn\" (UID: \"48e6aacc-fe74-403d-b4c1-e76379e0e214\") " pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"
Jul 02 23:42:57.554809 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.554789    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48e6aacc-fe74-403d-b4c1-e76379e0e214-maas-api-tls\") pod \"maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn\" (UID: \"48e6aacc-fe74-403d-b4c1-e76379e0e214\") " pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"
Jul 02 23:42:57.560767 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.560748    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts2bx\" (UniqueName: \"kubernetes.io/projected/48e6aacc-fe74-403d-b4c1-e76379e0e214-kube-api-access-ts2bx\") pod \"maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn\" (UID: \"48e6aacc-fe74-403d-b4c1-e76379e0e214\") " pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"
Jul 02 23:42:57.672330 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.672248    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"
Jul 02 23:42:57.805485 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:57.805457    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"]
Jul 02 23:42:57.807517 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:42:57.807492    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e6aacc_fe74_403d_b4c1_e76379e0e214.slice/crio-bf937195ba9583118eb2ec991162d8c6b96147dc0605a965fcaa00561e07cd30 WatchSource:0}: Error finding container bf937195ba9583118eb2ec991162d8c6b96147dc0605a965fcaa00561e07cd30: Status 404 returned error can't find the container with id bf937195ba9583118eb2ec991162d8c6b96147dc0605a965fcaa00561e07cd30
Jul 02 23:42:58.252046 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:58.251987    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn" event={"ID":"48e6aacc-fe74-403d-b4c1-e76379e0e214","Type":"ContainerStarted","Data":"e5918a7cf8f2c6318af73e85097db95bce51cc9aa7b322a3ef02e285e3373ba0"}
Jul 02 23:42:58.252213 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:58.252078    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"
Jul 02 23:42:58.252213 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:58.252104    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn" event={"ID":"48e6aacc-fe74-403d-b4c1-e76379e0e214","Type":"ContainerStarted","Data":"bf937195ba9583118eb2ec991162d8c6b96147dc0605a965fcaa00561e07cd30"}
Jul 02 23:42:58.268870 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:42:58.268818    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn" podStartSLOduration=0.887703393 podStartE2EDuration="1.268802603s" totalImagesPullingTime="381.09921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:42:58.268203376 +0000 UTC m=+1926.892621753" watchObservedRunningTime="2026-07-02 23:42:58.268802603 +0000 UTC m=+1926.893220980"
Jul 02 23:43:04.261504 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:04.261475    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"
Jul 02 23:43:05.696596 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:05.696564    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"]
Jul 02 23:43:05.700189 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:05.700162    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:43:05.703272 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:05.703248    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-fcd282-serving-cert\""
Jul 02 23:43:05.713991 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:05.713969    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"]
Jul 02 23:43:05.824810 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:05.824769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5tlf\" (UniqueName: \"kubernetes.io/projected/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-kube-api-access-l5tlf\") pod \"maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p\" (UID: \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\") " pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:43:05.825008 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:05.824897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p\" (UID: \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\") " pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:43:05.825008 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:05.824968    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-maas-api-tls\") pod \"maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p\" (UID: \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\") " pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:43:05.926148 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:05.926115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5tlf\" (UniqueName: \"kubernetes.io/projected/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-kube-api-access-l5tlf\") pod \"maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p\" (UID: \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\") " pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:43:05.926321 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:05.926251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p\" (UID: \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\") " pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:43:05.926321 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:05.926283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-maas-api-tls\") pod \"maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p\" (UID: \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\") " pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:43:05.926436 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:43:05.926363    2563 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-fcd282-serving-cert: secret "maas-api-e2e-shared-b-fcd282-serving-cert" not found
Jul 02 23:43:05.926436 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:43:05.926412    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-maas-api-tls podName:2829dd26-f367-4ea1-8ed1-2b42b3eddf15 nodeName:}" failed. No retries permitted until 2026-07-02 23:43:06.426397557 +0000 UTC m=+1935.050815910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-maas-api-tls") pod "maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p" (UID: "2829dd26-f367-4ea1-8ed1-2b42b3eddf15") : secret "maas-api-e2e-shared-b-fcd282-serving-cert" not found
Jul 02 23:43:05.926907 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:05.926883    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p\" (UID: \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\") " pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:43:05.937636 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:05.937614    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5tlf\" (UniqueName: \"kubernetes.io/projected/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-kube-api-access-l5tlf\") pod \"maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p\" (UID: \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\") " pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:43:06.430734 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:06.430696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-maas-api-tls\") pod \"maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p\" (UID: \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\") " pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:43:06.433091 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:06.433068    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-maas-api-tls\") pod \"maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p\" (UID: \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\") " pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:43:06.612586 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:06.612551    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:43:06.777740 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:06.777714    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"]
Jul 02 23:43:06.779457 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:43:06.779426    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2829dd26_f367_4ea1_8ed1_2b42b3eddf15.slice/crio-d8ca491f6b60c7b7fff5ac1343ffd20c212927354dad3188ac421461011f5f9a WatchSource:0}: Error finding container d8ca491f6b60c7b7fff5ac1343ffd20c212927354dad3188ac421461011f5f9a: Status 404 returned error can't find the container with id d8ca491f6b60c7b7fff5ac1343ffd20c212927354dad3188ac421461011f5f9a
Jul 02 23:43:07.295817 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:07.295784    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p" event={"ID":"2829dd26-f367-4ea1-8ed1-2b42b3eddf15","Type":"ContainerStarted","Data":"6af1f63b7f00bac86e78e8efb8af17cd50729d82bf46912d30c46989e1f01ccc"}
Jul 02 23:43:07.296013 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:07.295843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p" event={"ID":"2829dd26-f367-4ea1-8ed1-2b42b3eddf15","Type":"ContainerStarted","Data":"d8ca491f6b60c7b7fff5ac1343ffd20c212927354dad3188ac421461011f5f9a"}
Jul 02 23:43:07.296013 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:07.295871    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:43:07.313682 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:07.313636    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p" podStartSLOduration=2.0039196439999998 podStartE2EDuration="2.31362103s" totalImagesPullingTime="309.701386ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:43:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:43:07.311807937 +0000 UTC m=+1935.936226312" watchObservedRunningTime="2026-07-02 23:43:07.31362103 +0000 UTC m=+1935.938039406"
Jul 02 23:43:13.306201 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:43:13.306172    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:45:00.134635 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.134599    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq"]
Jul 02 23:45:00.137928 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.137903    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq"
Jul 02 23:45:00.140616 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.140589    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717265-8br4p"]
Jul 02 23:45:00.143578 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.143558    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8"]
Jul 02 23:45:00.143750 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.143730    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717265-8br4p"
Jul 02 23:45:00.146677 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.146662    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8"
Jul 02 23:45:00.149516 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.149494    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq"]
Jul 02 23:45:00.158402 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.158380    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717265-8br4p"]
Jul 02 23:45:00.159583 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.159547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjkzd\" (UniqueName: \"kubernetes.io/projected/f435e023-3f1a-49b6-b673-054e5ea8a7d3-kube-api-access-bjkzd\") pod \"maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq\" (UID: \"f435e023-3f1a-49b6-b673-054e5ea8a7d3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq"
Jul 02 23:45:00.168074 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.168053    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8"]
Jul 02 23:45:00.260777 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.260738    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bprn\" (UniqueName: \"kubernetes.io/projected/8d9f09ad-b47c-4d05-9286-41bb4b78ef11-kube-api-access-5bprn\") pod \"maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8\" (UID: \"8d9f09ad-b47c-4d05-9286-41bb4b78ef11\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8"
Jul 02 23:45:00.260993 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.260787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjkzd\" (UniqueName: \"kubernetes.io/projected/f435e023-3f1a-49b6-b673-054e5ea8a7d3-kube-api-access-bjkzd\") pod \"maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq\" (UID: \"f435e023-3f1a-49b6-b673-054e5ea8a7d3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq"
Jul 02 23:45:00.260993 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.260843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bnj9\" (UniqueName: \"kubernetes.io/projected/aa71f6d3-aea5-4c20-9542-9101b0135cef-kube-api-access-5bnj9\") pod \"maas-api-key-cleanup-29717265-8br4p\" (UID: \"aa71f6d3-aea5-4c20-9542-9101b0135cef\") " pod="opendatahub/maas-api-key-cleanup-29717265-8br4p"
Jul 02 23:45:00.269538 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.269512    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjkzd\" (UniqueName: \"kubernetes.io/projected/f435e023-3f1a-49b6-b673-054e5ea8a7d3-kube-api-access-bjkzd\") pod \"maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq\" (UID: \"f435e023-3f1a-49b6-b673-054e5ea8a7d3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq"
Jul 02 23:45:00.361687 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.361647    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bnj9\" (UniqueName: \"kubernetes.io/projected/aa71f6d3-aea5-4c20-9542-9101b0135cef-kube-api-access-5bnj9\") pod \"maas-api-key-cleanup-29717265-8br4p\" (UID: \"aa71f6d3-aea5-4c20-9542-9101b0135cef\") " pod="opendatahub/maas-api-key-cleanup-29717265-8br4p"
Jul 02 23:45:00.361887 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.361754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bprn\" (UniqueName: \"kubernetes.io/projected/8d9f09ad-b47c-4d05-9286-41bb4b78ef11-kube-api-access-5bprn\") pod \"maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8\" (UID: \"8d9f09ad-b47c-4d05-9286-41bb4b78ef11\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8"
Jul 02 23:45:00.370013 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.369990    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bprn\" (UniqueName: \"kubernetes.io/projected/8d9f09ad-b47c-4d05-9286-41bb4b78ef11-kube-api-access-5bprn\") pod \"maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8\" (UID: \"8d9f09ad-b47c-4d05-9286-41bb4b78ef11\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8"
Jul 02 23:45:00.370121 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.369996    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bnj9\" (UniqueName: \"kubernetes.io/projected/aa71f6d3-aea5-4c20-9542-9101b0135cef-kube-api-access-5bnj9\") pod \"maas-api-key-cleanup-29717265-8br4p\" (UID: \"aa71f6d3-aea5-4c20-9542-9101b0135cef\") " pod="opendatahub/maas-api-key-cleanup-29717265-8br4p"
Jul 02 23:45:00.449462 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.449392    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq"
Jul 02 23:45:00.460377 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.460358    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717265-8br4p"
Jul 02 23:45:00.467225 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.467203    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8"
Jul 02 23:45:00.608817 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.608792    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq"]
Jul 02 23:45:00.611151 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:45:00.611105    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf435e023_3f1a_49b6_b673_054e5ea8a7d3.slice/crio-0ecaaf5907fd5b792487f2e584ad8d6243d0d8bfe2d2256f95144cd1c0b8293b WatchSource:0}: Error finding container 0ecaaf5907fd5b792487f2e584ad8d6243d0d8bfe2d2256f95144cd1c0b8293b: Status 404 returned error can't find the container with id 0ecaaf5907fd5b792487f2e584ad8d6243d0d8bfe2d2256f95144cd1c0b8293b
Jul 02 23:45:00.843238 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.843151    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8"]
Jul 02 23:45:00.845361 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:45:00.845334    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d9f09ad_b47c_4d05_9286_41bb4b78ef11.slice/crio-dbabd5d2d3a4b619c1f499f87c6e872b751a6e5e20d7a4c523342cdb6cebfde2 WatchSource:0}: Error finding container dbabd5d2d3a4b619c1f499f87c6e872b751a6e5e20d7a4c523342cdb6cebfde2: Status 404 returned error can't find the container with id dbabd5d2d3a4b619c1f499f87c6e872b751a6e5e20d7a4c523342cdb6cebfde2
Jul 02 23:45:00.846908 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.846876    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717265-8br4p"]
Jul 02 23:45:00.848512 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:45:00.848492    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa71f6d3_aea5_4c20_9542_9101b0135cef.slice/crio-1907e62f90a3218654a7b0e1bd80bf39b643bdf177f0727a91024a601f473d60 WatchSource:0}: Error finding container 1907e62f90a3218654a7b0e1bd80bf39b643bdf177f0727a91024a601f473d60: Status 404 returned error can't find the container with id 1907e62f90a3218654a7b0e1bd80bf39b643bdf177f0727a91024a601f473d60
Jul 02 23:45:00.851764 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:00.851744    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq" event={"ID":"f435e023-3f1a-49b6-b673-054e5ea8a7d3","Type":"ContainerStarted","Data":"0ecaaf5907fd5b792487f2e584ad8d6243d0d8bfe2d2256f95144cd1c0b8293b"}
Jul 02 23:45:01.857975 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:01.857948    2563 generic.go:356] "Generic (PLEG): container finished" podID="f435e023-3f1a-49b6-b673-054e5ea8a7d3" containerID="9054baeac109ec1515bf354635fa8ba4c6e4c3782628483919871a25e65bcf90" exitCode=0
Jul 02 23:45:01.858332 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:01.857986    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq" event={"ID":"f435e023-3f1a-49b6-b673-054e5ea8a7d3","Type":"ContainerDied","Data":"9054baeac109ec1515bf354635fa8ba4c6e4c3782628483919871a25e65bcf90"}
Jul 02 23:45:01.859520 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:01.859496    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8" event={"ID":"8d9f09ad-b47c-4d05-9286-41bb4b78ef11","Type":"ContainerStarted","Data":"12844afdb177bc85ba05ed332b83b659e4de8dfbb3e2eeb5c2fce9e847cd92fa"}
Jul 02 23:45:01.859625 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:01.859540    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8" event={"ID":"8d9f09ad-b47c-4d05-9286-41bb4b78ef11","Type":"ContainerStarted","Data":"dbabd5d2d3a4b619c1f499f87c6e872b751a6e5e20d7a4c523342cdb6cebfde2"}
Jul 02 23:45:01.860831 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:01.860811    2563 generic.go:356] "Generic (PLEG): container finished" podID="aa71f6d3-aea5-4c20-9542-9101b0135cef" containerID="b9107bb76b8fb087a7533a185293c3902b93aa2ea6b9d6bd374c5d2a9ffbf810" exitCode=0
Jul 02 23:45:01.860905 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:01.860862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717265-8br4p" event={"ID":"aa71f6d3-aea5-4c20-9542-9101b0135cef","Type":"ContainerDied","Data":"b9107bb76b8fb087a7533a185293c3902b93aa2ea6b9d6bd374c5d2a9ffbf810"}
Jul 02 23:45:01.860905 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:01.860886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717265-8br4p" event={"ID":"aa71f6d3-aea5-4c20-9542-9101b0135cef","Type":"ContainerStarted","Data":"1907e62f90a3218654a7b0e1bd80bf39b643bdf177f0727a91024a601f473d60"}
Jul 02 23:45:01.907418 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:01.907335    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8" podStartSLOduration=1.9073208689999999 podStartE2EDuration="1.907320869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:45:01.907125748 +0000 UTC m=+2050.531544125" watchObservedRunningTime="2026-07-02 23:45:01.907320869 +0000 UTC m=+2050.531739245"
Jul 02 23:45:02.867718 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:02.867684    2563 generic.go:356] "Generic (PLEG): container finished" podID="8d9f09ad-b47c-4d05-9286-41bb4b78ef11" containerID="12844afdb177bc85ba05ed332b83b659e4de8dfbb3e2eeb5c2fce9e847cd92fa" exitCode=0
Jul 02 23:45:02.868159 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:02.867757    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8" event={"ID":"8d9f09ad-b47c-4d05-9286-41bb4b78ef11","Type":"ContainerDied","Data":"12844afdb177bc85ba05ed332b83b659e4de8dfbb3e2eeb5c2fce9e847cd92fa"}
Jul 02 23:45:03.011604 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:03.011575    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq"
Jul 02 23:45:03.042351 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:03.042328    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717265-8br4p"
Jul 02 23:45:03.084647 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:03.084620    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bnj9\" (UniqueName: \"kubernetes.io/projected/aa71f6d3-aea5-4c20-9542-9101b0135cef-kube-api-access-5bnj9\") pod \"aa71f6d3-aea5-4c20-9542-9101b0135cef\" (UID: \"aa71f6d3-aea5-4c20-9542-9101b0135cef\") "
Jul 02 23:45:03.084782 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:03.084714    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjkzd\" (UniqueName: \"kubernetes.io/projected/f435e023-3f1a-49b6-b673-054e5ea8a7d3-kube-api-access-bjkzd\") pod \"f435e023-3f1a-49b6-b673-054e5ea8a7d3\" (UID: \"f435e023-3f1a-49b6-b673-054e5ea8a7d3\") "
Jul 02 23:45:03.086656 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:03.086628    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa71f6d3-aea5-4c20-9542-9101b0135cef-kube-api-access-5bnj9" (OuterVolumeSpecName: "kube-api-access-5bnj9") pod "aa71f6d3-aea5-4c20-9542-9101b0135cef" (UID: "aa71f6d3-aea5-4c20-9542-9101b0135cef"). InnerVolumeSpecName "kube-api-access-5bnj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:45:03.086746 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:03.086678    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f435e023-3f1a-49b6-b673-054e5ea8a7d3-kube-api-access-bjkzd" (OuterVolumeSpecName: "kube-api-access-bjkzd") pod "f435e023-3f1a-49b6-b673-054e5ea8a7d3" (UID: "f435e023-3f1a-49b6-b673-054e5ea8a7d3"). InnerVolumeSpecName "kube-api-access-bjkzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:45:03.186244 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:03.186182    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bnj9\" (UniqueName: \"kubernetes.io/projected/aa71f6d3-aea5-4c20-9542-9101b0135cef-kube-api-access-5bnj9\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:45:03.186244 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:03.186208    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjkzd\" (UniqueName: \"kubernetes.io/projected/f435e023-3f1a-49b6-b673-054e5ea8a7d3-kube-api-access-bjkzd\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:45:03.874797 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:03.874765    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq"
Jul 02 23:45:03.874797 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:03.874780    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq" event={"ID":"f435e023-3f1a-49b6-b673-054e5ea8a7d3","Type":"ContainerDied","Data":"0ecaaf5907fd5b792487f2e584ad8d6243d0d8bfe2d2256f95144cd1c0b8293b"}
Jul 02 23:45:03.875255 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:03.874833    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ecaaf5907fd5b792487f2e584ad8d6243d0d8bfe2d2256f95144cd1c0b8293b"
Jul 02 23:45:03.876038 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:03.876010    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717265-8br4p"
Jul 02 23:45:03.876038 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:03.876036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717265-8br4p" event={"ID":"aa71f6d3-aea5-4c20-9542-9101b0135cef","Type":"ContainerDied","Data":"1907e62f90a3218654a7b0e1bd80bf39b643bdf177f0727a91024a601f473d60"}
Jul 02 23:45:03.876228 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:03.876063    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1907e62f90a3218654a7b0e1bd80bf39b643bdf177f0727a91024a601f473d60"
Jul 02 23:45:04.003056 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:04.003033    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8"
Jul 02 23:45:04.093174 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:04.093149    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bprn\" (UniqueName: \"kubernetes.io/projected/8d9f09ad-b47c-4d05-9286-41bb4b78ef11-kube-api-access-5bprn\") pod \"8d9f09ad-b47c-4d05-9286-41bb4b78ef11\" (UID: \"8d9f09ad-b47c-4d05-9286-41bb4b78ef11\") "
Jul 02 23:45:04.095174 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:04.095151    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d9f09ad-b47c-4d05-9286-41bb4b78ef11-kube-api-access-5bprn" (OuterVolumeSpecName: "kube-api-access-5bprn") pod "8d9f09ad-b47c-4d05-9286-41bb4b78ef11" (UID: "8d9f09ad-b47c-4d05-9286-41bb4b78ef11"). InnerVolumeSpecName "kube-api-access-5bprn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:45:04.194516 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:04.194461    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bprn\" (UniqueName: \"kubernetes.io/projected/8d9f09ad-b47c-4d05-9286-41bb4b78ef11-kube-api-access-5bprn\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:45:04.883529 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:04.883504    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8"
Jul 02 23:45:04.883902 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:04.883553    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8" event={"ID":"8d9f09ad-b47c-4d05-9286-41bb4b78ef11","Type":"ContainerDied","Data":"dbabd5d2d3a4b619c1f499f87c6e872b751a6e5e20d7a4c523342cdb6cebfde2"}
Jul 02 23:45:04.883902 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:04.883593    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbabd5d2d3a4b619c1f499f87c6e872b751a6e5e20d7a4c523342cdb6cebfde2"
Jul 02 23:45:35.588436 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.588361    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"]
Jul 02 23:45:35.588902 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.588757    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f435e023-3f1a-49b6-b673-054e5ea8a7d3" containerName="cleanup"
Jul 02 23:45:35.588902 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.588770    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f435e023-3f1a-49b6-b673-054e5ea8a7d3" containerName="cleanup"
Jul 02 23:45:35.588902 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.588788    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d9f09ad-b47c-4d05-9286-41bb4b78ef11" containerName="cleanup"
Jul 02 23:45:35.588902 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.588794    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d9f09ad-b47c-4d05-9286-41bb4b78ef11" containerName="cleanup"
Jul 02 23:45:35.588902 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.588801    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa71f6d3-aea5-4c20-9542-9101b0135cef" containerName="cleanup"
Jul 02 23:45:35.588902 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.588806    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa71f6d3-aea5-4c20-9542-9101b0135cef" containerName="cleanup"
Jul 02 23:45:35.588902 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.588887    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f435e023-3f1a-49b6-b673-054e5ea8a7d3" containerName="cleanup"
Jul 02 23:45:35.588902 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.588901    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa71f6d3-aea5-4c20-9542-9101b0135cef" containerName="cleanup"
Jul 02 23:45:35.589236 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.588911    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d9f09ad-b47c-4d05-9286-41bb4b78ef11" containerName="cleanup"
Jul 02 23:45:35.592159 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.592144    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.595984 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.595962    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9d43a8\"/\"default-dockercfg-mlnrv\""
Jul 02 23:45:35.596119 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.595963    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9d43a8\"/\"kube-root-ca.crt\""
Jul 02 23:45:35.596119 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.595961    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9d43a8\"/\"openshift-service-ca.crt\""
Jul 02 23:45:35.596119 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.595963    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9d43a8\"/\"sub-test-model-9d43a8-kserve-self-signed-certs\""
Jul 02 23:45:35.600646 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.600621    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"]
Jul 02 23:45:35.760083 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.760051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-tmp-dir\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.760083 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.760084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e9545e9-498c-4c8b-928e-ad7685808040-tls-certs\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.760338 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.760104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-model-cache\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.760338 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.760124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-dshm\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.760338 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.760145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psn2g\" (UniqueName: \"kubernetes.io/projected/1e9545e9-498c-4c8b-928e-ad7685808040-kube-api-access-psn2g\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.760338 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.760227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-home\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.861012 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.860937    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-tmp-dir\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.861012 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.860977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e9545e9-498c-4c8b-928e-ad7685808040-tls-certs\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.861012 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.860995    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-model-cache\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.861012 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.861014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-dshm\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.861325 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.861029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psn2g\" (UniqueName: \"kubernetes.io/projected/1e9545e9-498c-4c8b-928e-ad7685808040-kube-api-access-psn2g\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.861325 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.861053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-home\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.861424 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.861317    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-tmp-dir\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.861495 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.861474    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-home\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.861533 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.861494    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-model-cache\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.863250 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.863229    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-dshm\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.863523 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.863506    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e9545e9-498c-4c8b-928e-ad7685808040-tls-certs\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.869883 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.869859    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psn2g\" (UniqueName: \"kubernetes.io/projected/1e9545e9-498c-4c8b-928e-ad7685808040-kube-api-access-psn2g\") pod \"sub-test-model-9d43a8-kserve-68899944df-k9c2l\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") " pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:35.901749 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:35.901731    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:36.034303 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:36.034280    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"]
Jul 02 23:45:36.036517 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:45:36.036492    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e9545e9_498c_4c8b_928e_ad7685808040.slice/crio-f5d56060e41709f76d3d7cd7bc4c577d56314e226312d23964358d0dfe5823f7 WatchSource:0}: Error finding container f5d56060e41709f76d3d7cd7bc4c577d56314e226312d23964358d0dfe5823f7: Status 404 returned error can't find the container with id f5d56060e41709f76d3d7cd7bc4c577d56314e226312d23964358d0dfe5823f7
Jul 02 23:45:37.045203 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:37.045162    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l" event={"ID":"1e9545e9-498c-4c8b-928e-ad7685808040","Type":"ContainerStarted","Data":"48f08f7f3b255cbb91ee72e6d4a67e2a22e1b0b7fb5b9a5845d03a0170459713"}
Jul 02 23:45:37.045571 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:37.045212    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l" event={"ID":"1e9545e9-498c-4c8b-928e-ad7685808040","Type":"ContainerStarted","Data":"f5d56060e41709f76d3d7cd7bc4c577d56314e226312d23964358d0dfe5823f7"}
Jul 02 23:45:37.063102 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:37.063054    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l" podStartSLOduration=2.063040043 podStartE2EDuration="2.063040043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:45:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:45:37.061964596 +0000 UTC m=+2085.686382971" watchObservedRunningTime="2026-07-02 23:45:37.063040043 +0000 UTC m=+2085.687458419"
Jul 02 23:45:45.902289 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:45.902257    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:45.902696 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:45.902308    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:45.914784 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:45.914754    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:46.102008 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:46.101976    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:45:51.949660 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:51.949634    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:45:51.952116 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:45:51.951434    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:47:01.589175 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:01.589144    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"]
Jul 02 23:47:16.609322 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:16.609277    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l" podUID="1e9545e9-498c-4c8b-928e-ad7685808040" containerName="main" containerID="cri-o://48f08f7f3b255cbb91ee72e6d4a67e2a22e1b0b7fb5b9a5845d03a0170459713" gracePeriod=45
Jul 02 23:47:16.861893 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:16.861834    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:47:17.037836 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.037794    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-model-cache\") pod \"1e9545e9-498c-4c8b-928e-ad7685808040\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") "
Jul 02 23:47:17.037836 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.037839    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psn2g\" (UniqueName: \"kubernetes.io/projected/1e9545e9-498c-4c8b-928e-ad7685808040-kube-api-access-psn2g\") pod \"1e9545e9-498c-4c8b-928e-ad7685808040\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") "
Jul 02 23:47:17.038080 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.037866    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e9545e9-498c-4c8b-928e-ad7685808040-tls-certs\") pod \"1e9545e9-498c-4c8b-928e-ad7685808040\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") "
Jul 02 23:47:17.038080 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.037888    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-dshm\") pod \"1e9545e9-498c-4c8b-928e-ad7685808040\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") "
Jul 02 23:47:17.038080 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.037936    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-home\") pod \"1e9545e9-498c-4c8b-928e-ad7685808040\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") "
Jul 02 23:47:17.038080 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.038028    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-tmp-dir\") pod \"1e9545e9-498c-4c8b-928e-ad7685808040\" (UID: \"1e9545e9-498c-4c8b-928e-ad7685808040\") "
Jul 02 23:47:17.038298 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.038123    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-model-cache" (OuterVolumeSpecName: "model-cache") pod "1e9545e9-498c-4c8b-928e-ad7685808040" (UID: "1e9545e9-498c-4c8b-928e-ad7685808040"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:47:17.038354 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.038294    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-home" (OuterVolumeSpecName: "home") pod "1e9545e9-498c-4c8b-928e-ad7685808040" (UID: "1e9545e9-498c-4c8b-928e-ad7685808040"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:47:17.038354 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.038309    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1e9545e9-498c-4c8b-928e-ad7685808040" (UID: "1e9545e9-498c-4c8b-928e-ad7685808040"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:47:17.038354 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.038327    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-model-cache\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:47:17.040111 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.040083    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-dshm" (OuterVolumeSpecName: "dshm") pod "1e9545e9-498c-4c8b-928e-ad7685808040" (UID: "1e9545e9-498c-4c8b-928e-ad7685808040"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:47:17.040202 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.040164    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e9545e9-498c-4c8b-928e-ad7685808040-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1e9545e9-498c-4c8b-928e-ad7685808040" (UID: "1e9545e9-498c-4c8b-928e-ad7685808040"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:47:17.040242 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.040214    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e9545e9-498c-4c8b-928e-ad7685808040-kube-api-access-psn2g" (OuterVolumeSpecName: "kube-api-access-psn2g") pod "1e9545e9-498c-4c8b-928e-ad7685808040" (UID: "1e9545e9-498c-4c8b-928e-ad7685808040"). InnerVolumeSpecName "kube-api-access-psn2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:47:17.139397 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.139317    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psn2g\" (UniqueName: \"kubernetes.io/projected/1e9545e9-498c-4c8b-928e-ad7685808040-kube-api-access-psn2g\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:47:17.139397 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.139346    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e9545e9-498c-4c8b-928e-ad7685808040-tls-certs\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:47:17.139397 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.139357    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-dshm\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:47:17.139397 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.139365    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-home\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:47:17.139397 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.139372    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e9545e9-498c-4c8b-928e-ad7685808040-tmp-dir\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:47:17.547653 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.547567    2563 generic.go:356] "Generic (PLEG): container finished" podID="1e9545e9-498c-4c8b-928e-ad7685808040" containerID="48f08f7f3b255cbb91ee72e6d4a67e2a22e1b0b7fb5b9a5845d03a0170459713" exitCode=0
Jul 02 23:47:17.547653 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.547609    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"
Jul 02 23:47:17.547853 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.547650    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l" event={"ID":"1e9545e9-498c-4c8b-928e-ad7685808040","Type":"ContainerDied","Data":"48f08f7f3b255cbb91ee72e6d4a67e2a22e1b0b7fb5b9a5845d03a0170459713"}
Jul 02 23:47:17.547853 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.547688    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l" event={"ID":"1e9545e9-498c-4c8b-928e-ad7685808040","Type":"ContainerDied","Data":"f5d56060e41709f76d3d7cd7bc4c577d56314e226312d23964358d0dfe5823f7"}
Jul 02 23:47:17.547853 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.547704    2563 scope.go:117] "RemoveContainer" containerID="48f08f7f3b255cbb91ee72e6d4a67e2a22e1b0b7fb5b9a5845d03a0170459713"
Jul 02 23:47:17.556758 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.556742    2563 scope.go:117] "RemoveContainer" containerID="48f08f7f3b255cbb91ee72e6d4a67e2a22e1b0b7fb5b9a5845d03a0170459713"
Jul 02 23:47:17.557067 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:47:17.557049    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48f08f7f3b255cbb91ee72e6d4a67e2a22e1b0b7fb5b9a5845d03a0170459713\": container with ID starting with 48f08f7f3b255cbb91ee72e6d4a67e2a22e1b0b7fb5b9a5845d03a0170459713 not found: ID does not exist" containerID="48f08f7f3b255cbb91ee72e6d4a67e2a22e1b0b7fb5b9a5845d03a0170459713"
Jul 02 23:47:17.557113 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.557075    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48f08f7f3b255cbb91ee72e6d4a67e2a22e1b0b7fb5b9a5845d03a0170459713"} err="failed to get container status \"48f08f7f3b255cbb91ee72e6d4a67e2a22e1b0b7fb5b9a5845d03a0170459713\": rpc error: code = NotFound desc = could not find container \"48f08f7f3b255cbb91ee72e6d4a67e2a22e1b0b7fb5b9a5845d03a0170459713\": container with ID starting with 48f08f7f3b255cbb91ee72e6d4a67e2a22e1b0b7fb5b9a5845d03a0170459713 not found: ID does not exist"
Jul 02 23:47:17.569126 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.569104    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"]
Jul 02 23:47:17.572139 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.572118    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9d43a8/sub-test-model-9d43a8-kserve-68899944df-k9c2l"]
Jul 02 23:47:17.885771 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:47:17.885736    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e9545e9-498c-4c8b-928e-ad7685808040" path="/var/lib/kubelet/pods/1e9545e9-498c-4c8b-928e-ad7685808040/volumes"
Jul 02 23:48:57.992762 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:57.992730    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"]
Jul 02 23:48:57.993356 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:57.992980    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn" podUID="48e6aacc-fe74-403d-b4c1-e76379e0e214" containerName="maas-api" containerID="cri-o://e5918a7cf8f2c6318af73e85097db95bce51cc9aa7b322a3ef02e285e3373ba0" gracePeriod=30
Jul 02 23:48:58.021036 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:58.020996    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq"]
Jul 02 23:48:58.024657 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:58.024634    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-9d43a8-29717265-kn7pq"]
Jul 02 23:48:58.239156 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:58.239132    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"
Jul 02 23:48:58.327418 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:58.327336    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48e6aacc-fe74-403d-b4c1-e76379e0e214-maas-api-tls\") pod \"48e6aacc-fe74-403d-b4c1-e76379e0e214\" (UID: \"48e6aacc-fe74-403d-b4c1-e76379e0e214\") "
Jul 02 23:48:58.327418 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:58.327393    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts2bx\" (UniqueName: \"kubernetes.io/projected/48e6aacc-fe74-403d-b4c1-e76379e0e214-kube-api-access-ts2bx\") pod \"48e6aacc-fe74-403d-b4c1-e76379e0e214\" (UID: \"48e6aacc-fe74-403d-b4c1-e76379e0e214\") "
Jul 02 23:48:58.327637 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:58.327490    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48e6aacc-fe74-403d-b4c1-e76379e0e214-openshift-service-ca\") pod \"48e6aacc-fe74-403d-b4c1-e76379e0e214\" (UID: \"48e6aacc-fe74-403d-b4c1-e76379e0e214\") "
Jul 02 23:48:58.327811 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:58.327786    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48e6aacc-fe74-403d-b4c1-e76379e0e214-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "48e6aacc-fe74-403d-b4c1-e76379e0e214" (UID: "48e6aacc-fe74-403d-b4c1-e76379e0e214"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:48:58.329442 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:58.329419    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48e6aacc-fe74-403d-b4c1-e76379e0e214-kube-api-access-ts2bx" (OuterVolumeSpecName: "kube-api-access-ts2bx") pod "48e6aacc-fe74-403d-b4c1-e76379e0e214" (UID: "48e6aacc-fe74-403d-b4c1-e76379e0e214"). InnerVolumeSpecName "kube-api-access-ts2bx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:48:58.329553 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:58.329471    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48e6aacc-fe74-403d-b4c1-e76379e0e214-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "48e6aacc-fe74-403d-b4c1-e76379e0e214" (UID: "48e6aacc-fe74-403d-b4c1-e76379e0e214"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:48:58.428429 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:58.428392    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts2bx\" (UniqueName: \"kubernetes.io/projected/48e6aacc-fe74-403d-b4c1-e76379e0e214-kube-api-access-ts2bx\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:48:58.428429 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:58.428422    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48e6aacc-fe74-403d-b4c1-e76379e0e214-openshift-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:48:58.428429 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:58.428432    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48e6aacc-fe74-403d-b4c1-e76379e0e214-maas-api-tls\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:48:59.046901 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:59.046864    2563 generic.go:356] "Generic (PLEG): container finished" podID="48e6aacc-fe74-403d-b4c1-e76379e0e214" containerID="e5918a7cf8f2c6318af73e85097db95bce51cc9aa7b322a3ef02e285e3373ba0" exitCode=0
Jul 02 23:48:59.047385 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:59.046945    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"
Jul 02 23:48:59.047385 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:59.046953    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn" event={"ID":"48e6aacc-fe74-403d-b4c1-e76379e0e214","Type":"ContainerDied","Data":"e5918a7cf8f2c6318af73e85097db95bce51cc9aa7b322a3ef02e285e3373ba0"}
Jul 02 23:48:59.047385 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:59.047024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn" event={"ID":"48e6aacc-fe74-403d-b4c1-e76379e0e214","Type":"ContainerDied","Data":"bf937195ba9583118eb2ec991162d8c6b96147dc0605a965fcaa00561e07cd30"}
Jul 02 23:48:59.047385 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:59.047056    2563 scope.go:117] "RemoveContainer" containerID="e5918a7cf8f2c6318af73e85097db95bce51cc9aa7b322a3ef02e285e3373ba0"
Jul 02 23:48:59.056622 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:59.056605    2563 scope.go:117] "RemoveContainer" containerID="e5918a7cf8f2c6318af73e85097db95bce51cc9aa7b322a3ef02e285e3373ba0"
Jul 02 23:48:59.056864 ip-10-0-134-28 kubenswrapper[2563]: E0702 23:48:59.056849    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5918a7cf8f2c6318af73e85097db95bce51cc9aa7b322a3ef02e285e3373ba0\": container with ID starting with e5918a7cf8f2c6318af73e85097db95bce51cc9aa7b322a3ef02e285e3373ba0 not found: ID does not exist" containerID="e5918a7cf8f2c6318af73e85097db95bce51cc9aa7b322a3ef02e285e3373ba0"
Jul 02 23:48:59.056925 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:59.056871    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5918a7cf8f2c6318af73e85097db95bce51cc9aa7b322a3ef02e285e3373ba0"} err="failed to get container status \"e5918a7cf8f2c6318af73e85097db95bce51cc9aa7b322a3ef02e285e3373ba0\": rpc error: code = NotFound desc = could not find container \"e5918a7cf8f2c6318af73e85097db95bce51cc9aa7b322a3ef02e285e3373ba0\": container with ID starting with e5918a7cf8f2c6318af73e85097db95bce51cc9aa7b322a3ef02e285e3373ba0 not found: ID does not exist"
Jul 02 23:48:59.070163 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:59.070136    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"]
Jul 02 23:48:59.074381 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:59.074358    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9d43a8-769f94758d-h2kmn"]
Jul 02 23:48:59.891829 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:59.891787    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48e6aacc-fe74-403d-b4c1-e76379e0e214" path="/var/lib/kubelet/pods/48e6aacc-fe74-403d-b4c1-e76379e0e214/volumes"
Jul 02 23:48:59.892214 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:48:59.892193    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f435e023-3f1a-49b6-b673-054e5ea8a7d3" path="/var/lib/kubelet/pods/f435e023-3f1a-49b6-b673-054e5ea8a7d3/volumes"
Jul 02 23:49:41.032773 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.032730    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"]
Jul 02 23:49:41.033413 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.033020    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p" podUID="2829dd26-f367-4ea1-8ed1-2b42b3eddf15" containerName="maas-api" containerID="cri-o://6af1f63b7f00bac86e78e8efb8af17cd50729d82bf46912d30c46989e1f01ccc" gracePeriod=30
Jul 02 23:49:41.061064 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.061036    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8"]
Jul 02 23:49:41.063545 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.063520    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-fcd282-29717265-f8tf8"]
Jul 02 23:49:41.263469 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.263440    2563 generic.go:356] "Generic (PLEG): container finished" podID="2829dd26-f367-4ea1-8ed1-2b42b3eddf15" containerID="6af1f63b7f00bac86e78e8efb8af17cd50729d82bf46912d30c46989e1f01ccc" exitCode=0
Jul 02 23:49:41.263577 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.263518    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p" event={"ID":"2829dd26-f367-4ea1-8ed1-2b42b3eddf15","Type":"ContainerDied","Data":"6af1f63b7f00bac86e78e8efb8af17cd50729d82bf46912d30c46989e1f01ccc"}
Jul 02 23:49:41.263626 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.263576    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p" event={"ID":"2829dd26-f367-4ea1-8ed1-2b42b3eddf15","Type":"ContainerDied","Data":"d8ca491f6b60c7b7fff5ac1343ffd20c212927354dad3188ac421461011f5f9a"}
Jul 02 23:49:41.263626 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.263600    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8ca491f6b60c7b7fff5ac1343ffd20c212927354dad3188ac421461011f5f9a"
Jul 02 23:49:41.277878 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.277856    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:49:41.383310 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.383273    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-maas-api-tls\") pod \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\" (UID: \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\") "
Jul 02 23:49:41.383501 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.383332    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5tlf\" (UniqueName: \"kubernetes.io/projected/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-kube-api-access-l5tlf\") pod \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\" (UID: \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\") "
Jul 02 23:49:41.383501 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.383404    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-openshift-service-ca\") pod \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\" (UID: \"2829dd26-f367-4ea1-8ed1-2b42b3eddf15\") "
Jul 02 23:49:41.383803 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.383772    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2829dd26-f367-4ea1-8ed1-2b42b3eddf15" (UID: "2829dd26-f367-4ea1-8ed1-2b42b3eddf15"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:49:41.385573 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.385552    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2829dd26-f367-4ea1-8ed1-2b42b3eddf15" (UID: "2829dd26-f367-4ea1-8ed1-2b42b3eddf15"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:49:41.385651 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.385630    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-kube-api-access-l5tlf" (OuterVolumeSpecName: "kube-api-access-l5tlf") pod "2829dd26-f367-4ea1-8ed1-2b42b3eddf15" (UID: "2829dd26-f367-4ea1-8ed1-2b42b3eddf15"). InnerVolumeSpecName "kube-api-access-l5tlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:49:41.484372 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.484336    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-openshift-service-ca\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:49:41.484372 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.484365    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-maas-api-tls\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:49:41.484372 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.484377    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5tlf\" (UniqueName: \"kubernetes.io/projected/2829dd26-f367-4ea1-8ed1-2b42b3eddf15-kube-api-access-l5tlf\") on node \"ip-10-0-134-28.ec2.internal\" DevicePath \"\""
Jul 02 23:49:41.891559 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:41.891524    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d9f09ad-b47c-4d05-9286-41bb4b78ef11" path="/var/lib/kubelet/pods/8d9f09ad-b47c-4d05-9286-41bb4b78ef11/volumes"
Jul 02 23:49:42.268286 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:42.268186    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"
Jul 02 23:49:42.284867 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:42.284833    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"]
Jul 02 23:49:42.291281 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:42.291257    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fcd282-65cfdb7fc5-9k67p"]
Jul 02 23:49:43.885907 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:43.885875    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2829dd26-f367-4ea1-8ed1-2b42b3eddf15" path="/var/lib/kubelet/pods/2829dd26-f367-4ea1-8ed1-2b42b3eddf15/volumes"
Jul 02 23:49:47.613016 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:47.612949    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76fdf5c8c4-xkj2x_e23e79b1-0a34-4395-b4b2-43c204266296/authorino/0.log"
Jul 02 23:49:52.094047 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:52.094021    2563 scope.go:117] "RemoveContainer" containerID="6af1f63b7f00bac86e78e8efb8af17cd50729d82bf46912d30c46989e1f01ccc"
Jul 02 23:49:52.512898 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:52.512824    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7bc66f69d9-f4x49_f3af4915-5f65-4312-98dd-343bcd52814b/maas-api/0.log"
Jul 02 23:49:52.622246 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:52.622218    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717250-6r7pv_38bbef7a-c259-4e6e-89c8-07e80d244f38/cleanup/0.log"
Jul 02 23:49:52.734650 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:52.734624    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717265-8br4p_aa71f6d3-aea5-4c20-9542-9101b0135cef/cleanup/0.log"
Jul 02 23:49:52.854022 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:52.853982    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58bb66898f-zbbwm_c2886187-4e96-4ba5-9000-6fb5d4c4fc93/manager/0.log"
Jul 02 23:49:52.969471 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:52.969447    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dtgnj_9ed53ccc-181f-49ca-9a06-786b75d0b9c2/server/0.log"
Jul 02 23:49:53.461743 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:53.461717    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d98bc9d58-xs7ck_6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc/copy-manifests/0.log"
Jul 02 23:49:53.468857 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:53.468836    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d98bc9d58-xs7ck_6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc/manager/0.log"
Jul 02 23:49:54.836137 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:54.836093    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76fdf5c8c4-xkj2x_e23e79b1-0a34-4395-b4b2-43c204266296/authorino/0.log"
Jul 02 23:49:56.382280 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:56.382243    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b76b84765-84r9v_c13fecf7-9389-446d-b7ae-4976d04ed486/kube-auth-proxy/0.log"
Jul 02 23:49:56.860120 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:56.860095    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bf5644d8f-z2hn2_44bb06c8-7187-4452-9d34-7d8094f61e3c/router/0.log"
Jul 02 23:49:57.313724 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:49:57.313654    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-ps9k2_4db993a4-f7d3-4f34-9274-11d5d82b807a/main/0.log"
Jul 02 23:50:01.899136 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.899107    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vvcqv/must-gather-l9kb4"]
Jul 02 23:50:01.899495 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.899434    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48e6aacc-fe74-403d-b4c1-e76379e0e214" containerName="maas-api"
Jul 02 23:50:01.899495 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.899447    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="48e6aacc-fe74-403d-b4c1-e76379e0e214" containerName="maas-api"
Jul 02 23:50:01.899495 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.899460    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2829dd26-f367-4ea1-8ed1-2b42b3eddf15" containerName="maas-api"
Jul 02 23:50:01.899495 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.899465    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2829dd26-f367-4ea1-8ed1-2b42b3eddf15" containerName="maas-api"
Jul 02 23:50:01.899495 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.899476    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e9545e9-498c-4c8b-928e-ad7685808040" containerName="main"
Jul 02 23:50:01.899495 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.899481    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e9545e9-498c-4c8b-928e-ad7685808040" containerName="main"
Jul 02 23:50:01.899681 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.899538    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e9545e9-498c-4c8b-928e-ad7685808040" containerName="main"
Jul 02 23:50:01.899681 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.899548    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2829dd26-f367-4ea1-8ed1-2b42b3eddf15" containerName="maas-api"
Jul 02 23:50:01.899681 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.899555    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="48e6aacc-fe74-403d-b4c1-e76379e0e214" containerName="maas-api"
Jul 02 23:50:01.902454 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.902437    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vvcqv/must-gather-l9kb4"
Jul 02 23:50:01.909750 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.909725    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vvcqv\"/\"kube-root-ca.crt\""
Jul 02 23:50:01.910420 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.910356    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vvcqv\"/\"default-dockercfg-jlszs\""
Jul 02 23:50:01.910748 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.910726    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vvcqv\"/\"openshift-service-ca.crt\""
Jul 02 23:50:01.913718 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.913696    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vvcqv/must-gather-l9kb4"]
Jul 02 23:50:01.954584 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.954552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvcz2\" (UniqueName: \"kubernetes.io/projected/9093ef11-de78-4ff4-bc89-f809872f3b5f-kube-api-access-wvcz2\") pod \"must-gather-l9kb4\" (UID: \"9093ef11-de78-4ff4-bc89-f809872f3b5f\") " pod="openshift-must-gather-vvcqv/must-gather-l9kb4"
Jul 02 23:50:01.954763 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:01.954590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9093ef11-de78-4ff4-bc89-f809872f3b5f-must-gather-output\") pod \"must-gather-l9kb4\" (UID: \"9093ef11-de78-4ff4-bc89-f809872f3b5f\") " pod="openshift-must-gather-vvcqv/must-gather-l9kb4"
Jul 02 23:50:02.055179 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:02.055147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvcz2\" (UniqueName: \"kubernetes.io/projected/9093ef11-de78-4ff4-bc89-f809872f3b5f-kube-api-access-wvcz2\") pod \"must-gather-l9kb4\" (UID: \"9093ef11-de78-4ff4-bc89-f809872f3b5f\") " pod="openshift-must-gather-vvcqv/must-gather-l9kb4"
Jul 02 23:50:02.055324 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:02.055188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9093ef11-de78-4ff4-bc89-f809872f3b5f-must-gather-output\") pod \"must-gather-l9kb4\" (UID: \"9093ef11-de78-4ff4-bc89-f809872f3b5f\") " pod="openshift-must-gather-vvcqv/must-gather-l9kb4"
Jul 02 23:50:02.055457 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:02.055441    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9093ef11-de78-4ff4-bc89-f809872f3b5f-must-gather-output\") pod \"must-gather-l9kb4\" (UID: \"9093ef11-de78-4ff4-bc89-f809872f3b5f\") " pod="openshift-must-gather-vvcqv/must-gather-l9kb4"
Jul 02 23:50:02.064072 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:02.064047    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvcz2\" (UniqueName: \"kubernetes.io/projected/9093ef11-de78-4ff4-bc89-f809872f3b5f-kube-api-access-wvcz2\") pod \"must-gather-l9kb4\" (UID: \"9093ef11-de78-4ff4-bc89-f809872f3b5f\") " pod="openshift-must-gather-vvcqv/must-gather-l9kb4"
Jul 02 23:50:02.219831 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:02.219757    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vvcqv/must-gather-l9kb4"
Jul 02 23:50:02.349934 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:02.349894    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vvcqv/must-gather-l9kb4"]
Jul 02 23:50:02.352221 ip-10-0-134-28 kubenswrapper[2563]: W0702 23:50:02.352177    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9093ef11_de78_4ff4_bc89_f809872f3b5f.slice/crio-658a5eb8738f98ab4880d226790fd5f6fac6dc9e6a22cdd519694782b59dbf1f WatchSource:0}: Error finding container 658a5eb8738f98ab4880d226790fd5f6fac6dc9e6a22cdd519694782b59dbf1f: Status 404 returned error can't find the container with id 658a5eb8738f98ab4880d226790fd5f6fac6dc9e6a22cdd519694782b59dbf1f
Jul 02 23:50:02.354398 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:02.354382    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:50:02.362960 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:02.362937    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vvcqv/must-gather-l9kb4" event={"ID":"9093ef11-de78-4ff4-bc89-f809872f3b5f","Type":"ContainerStarted","Data":"658a5eb8738f98ab4880d226790fd5f6fac6dc9e6a22cdd519694782b59dbf1f"}
Jul 02 23:50:04.377464 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:04.377426    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vvcqv/must-gather-l9kb4" event={"ID":"9093ef11-de78-4ff4-bc89-f809872f3b5f","Type":"ContainerStarted","Data":"2319f927d7d09922392a67de51bed749099a9c158e8886f3732b98c82e7ad50b"}
Jul 02 23:50:04.377991 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:04.377479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vvcqv/must-gather-l9kb4" event={"ID":"9093ef11-de78-4ff4-bc89-f809872f3b5f","Type":"ContainerStarted","Data":"a627e19ca6164be9ec1b2b489d9c0fc2c07bd493585c9ce27b200c9712e3b0b4"}
Jul 02 23:50:04.396225 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:04.396133    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vvcqv/must-gather-l9kb4" podStartSLOduration=2.442527483 podStartE2EDuration="3.396108323s" totalImagesPullingTime="953.58084ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:50:04.39474256 +0000 UTC m=+2353.019160939" watchObservedRunningTime="2026-07-02 23:50:04.396108323 +0000 UTC m=+2353.020526699"
Jul 02 23:50:04.859625 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:04.859591    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fjtpp_904dd94e-b420-4d10-a889-3dd86aecf071/global-pull-secret-syncer/0.log"
Jul 02 23:50:05.023698 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:05.023671    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pzkxh_03629f7d-15f4-4e0c-931c-fbcb131fa7c3/konnectivity-agent/0.log"
Jul 02 23:50:05.098629 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:05.098596    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-28.ec2.internal_64a5aa117e63441d09828f87cebc30e8/haproxy/0.log"
Jul 02 23:50:10.136860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:10.136818    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-76fdf5c8c4-xkj2x_e23e79b1-0a34-4395-b4b2-43c204266296/authorino/0.log"
Jul 02 23:50:12.385154 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:12.385123    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-7tlln_bd26f6f0-1585-45d3-8b38-c8fed2255d7e/cluster-monitoring-operator/0.log"
Jul 02 23:50:12.560588 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:12.560547    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2njzq_9a19d3b9-5884-4368-a62d-de415fc84adf/node-exporter/0.log"
Jul 02 23:50:12.584048 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:12.584020    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2njzq_9a19d3b9-5884-4368-a62d-de415fc84adf/kube-rbac-proxy/0.log"
Jul 02 23:50:12.606228 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:12.606193    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2njzq_9a19d3b9-5884-4368-a62d-de415fc84adf/init-textfile/0.log"
Jul 02 23:50:13.111746 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:13.111710    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-2k2pj_03497354-a870-46b5-987a-b70aa5245dfb/prometheus-operator-admission-webhook/0.log"
Jul 02 23:50:14.364860 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.364827    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"]
Jul 02 23:50:14.372568 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.372505    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.376674 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.376646    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"]
Jul 02 23:50:14.493186 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.493161    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-67phh_10b07ca3-e57c-4169-998a-2351dc0dcf1d/networking-console-plugin/0.log"
Jul 02 23:50:14.518423 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.518392    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0a3bb770-188c-4bb7-9b5a-71ec9e868557-proc\") pod \"perf-node-gather-daemonset-69mlt\" (UID: \"0a3bb770-188c-4bb7-9b5a-71ec9e868557\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.518591 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.518440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a3bb770-188c-4bb7-9b5a-71ec9e868557-sys\") pod \"perf-node-gather-daemonset-69mlt\" (UID: \"0a3bb770-188c-4bb7-9b5a-71ec9e868557\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.518591 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.518465    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0a3bb770-188c-4bb7-9b5a-71ec9e868557-podres\") pod \"perf-node-gather-daemonset-69mlt\" (UID: \"0a3bb770-188c-4bb7-9b5a-71ec9e868557\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.518591 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.518524    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a3bb770-188c-4bb7-9b5a-71ec9e868557-lib-modules\") pod \"perf-node-gather-daemonset-69mlt\" (UID: \"0a3bb770-188c-4bb7-9b5a-71ec9e868557\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.518701 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.518636    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs596\" (UniqueName: \"kubernetes.io/projected/0a3bb770-188c-4bb7-9b5a-71ec9e868557-kube-api-access-cs596\") pod \"perf-node-gather-daemonset-69mlt\" (UID: \"0a3bb770-188c-4bb7-9b5a-71ec9e868557\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.620185 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.620085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a3bb770-188c-4bb7-9b5a-71ec9e868557-lib-modules\") pod \"perf-node-gather-daemonset-69mlt\" (UID: \"0a3bb770-188c-4bb7-9b5a-71ec9e868557\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.620483 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.620465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs596\" (UniqueName: \"kubernetes.io/projected/0a3bb770-188c-4bb7-9b5a-71ec9e868557-kube-api-access-cs596\") pod \"perf-node-gather-daemonset-69mlt\" (UID: \"0a3bb770-188c-4bb7-9b5a-71ec9e868557\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.620639 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.620626    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0a3bb770-188c-4bb7-9b5a-71ec9e868557-proc\") pod \"perf-node-gather-daemonset-69mlt\" (UID: \"0a3bb770-188c-4bb7-9b5a-71ec9e868557\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.620761 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.620747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a3bb770-188c-4bb7-9b5a-71ec9e868557-sys\") pod \"perf-node-gather-daemonset-69mlt\" (UID: \"0a3bb770-188c-4bb7-9b5a-71ec9e868557\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.620850 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.620839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0a3bb770-188c-4bb7-9b5a-71ec9e868557-podres\") pod \"perf-node-gather-daemonset-69mlt\" (UID: \"0a3bb770-188c-4bb7-9b5a-71ec9e868557\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.621116 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.621098    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0a3bb770-188c-4bb7-9b5a-71ec9e868557-podres\") pod \"perf-node-gather-daemonset-69mlt\" (UID: \"0a3bb770-188c-4bb7-9b5a-71ec9e868557\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.621764 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.621626    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a3bb770-188c-4bb7-9b5a-71ec9e868557-lib-modules\") pod \"perf-node-gather-daemonset-69mlt\" (UID: \"0a3bb770-188c-4bb7-9b5a-71ec9e868557\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.621897 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.621671    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0a3bb770-188c-4bb7-9b5a-71ec9e868557-proc\") pod \"perf-node-gather-daemonset-69mlt\" (UID: \"0a3bb770-188c-4bb7-9b5a-71ec9e868557\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.622009 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.621708    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a3bb770-188c-4bb7-9b5a-71ec9e868557-sys\") pod \"perf-node-gather-daemonset-69mlt\" (UID: \"0a3bb770-188c-4bb7-9b5a-71ec9e868557\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.630511 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.630486    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs596\" (UniqueName: \"kubernetes.io/projected/0a3bb770-188c-4bb7-9b5a-71ec9e868557-kube-api-access-cs596\") pod \"perf-node-gather-daemonset-69mlt\" (UID: \"0a3bb770-188c-4bb7-9b5a-71ec9e868557\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.687495 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.687451    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:14.890841 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:14.890801    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"]
Jul 02 23:50:15.154818 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:15.154742    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/2.log"
Jul 02 23:50:15.160306 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:15.160277    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-8jdxr_823999b1-3441-46f4-bc9b-d4fea707df74/console-operator/3.log"
Jul 02 23:50:15.467620 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:15.467527    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt" event={"ID":"0a3bb770-188c-4bb7-9b5a-71ec9e868557","Type":"ContainerStarted","Data":"42882c3af49969d90554f1675d334df7a27681097a7c73e69854463cf18cd28f"}
Jul 02 23:50:15.467620 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:15.467617    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt" event={"ID":"0a3bb770-188c-4bb7-9b5a-71ec9e868557","Type":"ContainerStarted","Data":"2a78c5b512d8c03a230077756df73705f8a5de7fc10d0c2425146e6ca1eb82b5"}
Jul 02 23:50:15.468154 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:15.467647    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:15.484188 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:15.484113    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt" podStartSLOduration=1.48409269 podStartE2EDuration="1.48409269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:50:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:50:15.482569412 +0000 UTC m=+2364.106987789" watchObservedRunningTime="2026-07-02 23:50:15.48409269 +0000 UTC m=+2364.108511065"
Jul 02 23:50:15.650133 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:15.650107    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b7dd5b4d9-rdbf8_f7fe2462-c745-4769-9a02-7b40acbf13c9/console/0.log"
Jul 02 23:50:15.687230 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:15.687201    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-hn444_8a361e93-6142-4060-9b70-a94e8f54ec24/download-server/0.log"
Jul 02 23:50:16.232409 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:16.232382    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-74p9r_67181f51-bec1-45d0-a1a5-f60f25e7d392/volume-data-source-validator/0.log"
Jul 02 23:50:17.229540 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:17.229511    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-25fl5_19854b9a-bf87-470b-8247-726cf8e416a9/dns/0.log"
Jul 02 23:50:17.255963 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:17.255939    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-25fl5_19854b9a-bf87-470b-8247-726cf8e416a9/kube-rbac-proxy/0.log"
Jul 02 23:50:17.378054 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:17.378022    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-48c2d_98d4d36e-f535-4b18-bec3-f6e8057253c4/dns-node-resolver/0.log"
Jul 02 23:50:18.024655 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:18.024622    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v69lx_2a588334-ee3c-4a30-a704-5e42f0dfae27/node-ca/0.log"
Jul 02 23:50:19.207692 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:19.207668    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b76b84765-84r9v_c13fecf7-9389-446d-b7ae-4976d04ed486/kube-auth-proxy/0.log"
Jul 02 23:50:19.366809 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:19.366782    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bf5644d8f-z2hn2_44bb06c8-7187-4452-9d34-7d8094f61e3c/router/0.log"
Jul 02 23:50:20.054232 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:20.054206    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jhbxf_53af15b8-273e-497b-8923-ef7a99665e48/serve-healthcheck-canary/0.log"
Jul 02 23:50:20.550824 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:20.550795    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-bw4cj_9874c716-714c-46b7-a814-a4634c608e26/insights-operator/0.log"
Jul 02 23:50:20.551371 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:20.551345    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-bw4cj_9874c716-714c-46b7-a814-a4634c608e26/insights-operator/1.log"
Jul 02 23:50:20.710648 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:20.710615    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nmn8c_c68d2447-a88a-40ba-a9a3-82a40ef83b8f/kube-rbac-proxy/0.log"
Jul 02 23:50:20.732054 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:20.732028    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nmn8c_c68d2447-a88a-40ba-a9a3-82a40ef83b8f/exporter/0.log"
Jul 02 23:50:20.754375 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:20.754347    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nmn8c_c68d2447-a88a-40ba-a9a3-82a40ef83b8f/extractor/0.log"
Jul 02 23:50:21.485773 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:21.485744    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-69mlt"
Jul 02 23:50:23.067741 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:23.067703    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7bc66f69d9-f4x49_f3af4915-5f65-4312-98dd-343bcd52814b/maas-api/0.log"
Jul 02 23:50:23.094669 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:23.094639    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717250-6r7pv_38bbef7a-c259-4e6e-89c8-07e80d244f38/cleanup/0.log"
Jul 02 23:50:23.120310 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:23.120281    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717265-8br4p_aa71f6d3-aea5-4c20-9542-9101b0135cef/cleanup/0.log"
Jul 02 23:50:23.254985 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:23.253561    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58bb66898f-zbbwm_c2886187-4e96-4ba5-9000-6fb5d4c4fc93/manager/0.log"
Jul 02 23:50:23.278264 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:23.278234    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-dtgnj_9ed53ccc-181f-49ca-9a06-786b75d0b9c2/server/0.log"
Jul 02 23:50:23.560894 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:23.560863    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d98bc9d58-xs7ck_6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc/manager/0.log"
Jul 02 23:50:23.584671 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:23.584644    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d98bc9d58-xs7ck_6cabd2e9-c3e3-4bec-8d0f-eb7c5d407dcc/copy-manifests/0.log"
Jul 02 23:50:24.981016 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:24.980986    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-747bc6df4d-hr28b_fa373d68-7029-4639-a58e-d510a14bd1c9/manager/0.log"
Jul 02 23:50:25.032258 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:25.032166    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5wxmc_f8affe14-1235-4476-8610-99215a412d82/openshift-lws-operator/0.log"
Jul 02 23:50:25.081153 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:25.081126    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b76b84765-84r9v_c13fecf7-9389-446d-b7ae-4976d04ed486/kube-auth-proxy/0.log"
Jul 02 23:50:25.208640 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:25.208601    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bf5644d8f-z2hn2_44bb06c8-7187-4452-9d34-7d8094f61e3c/router/0.log"
Jul 02 23:50:26.590586 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:26.590561    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b76b84765-84r9v_c13fecf7-9389-446d-b7ae-4976d04ed486/kube-auth-proxy/0.log"
Jul 02 23:50:26.723302 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:26.723276    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bf5644d8f-z2hn2_44bb06c8-7187-4452-9d34-7d8094f61e3c/router/0.log"
Jul 02 23:50:30.263488 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:30.263438    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-bgzln_a3f9c3bd-e3f0-4b40-885e-568e2fe525ba/kube-storage-version-migrator-operator/1.log"
Jul 02 23:50:30.264512 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:30.264494    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-bgzln_a3f9c3bd-e3f0-4b40-885e-568e2fe525ba/kube-storage-version-migrator-operator/0.log"
Jul 02 23:50:31.618388 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:31.618352    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mmpkm_ab285b66-20ac-4558-9ed4-900dd2e75ec3/kube-multus-additional-cni-plugins/0.log"
Jul 02 23:50:31.641241 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:31.641218    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mmpkm_ab285b66-20ac-4558-9ed4-900dd2e75ec3/egress-router-binary-copy/0.log"
Jul 02 23:50:31.664594 ip-10-0-134-28 kubenswrapper[2563]: I0702 23:50:31.664567    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mmpkm_ab285b66-20ac-4558-9ed4-900dd2e75ec3/cni-plugins/0.log"