Jul 14 01:59:39.952388 ip-10-0-129-135 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 14 01:59:39.952397 ip-10-0-129-135 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 14 01:59:39.952404 ip-10-0-129-135 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 14 01:59:39.952674 ip-10-0-129-135 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 14 01:59:49.356229 ip-10-0-129-135 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 14 01:59:49.356245 ip-10-0-129-135 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d2b0094f43274797ab5fbde06d7f03a6 --
Jul 14 02:01:17.736666 ip-10-0-129-135 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 02:01:18.386250 ip-10-0-129-135 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 02:01:18.386250 ip-10-0-129-135 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 02:01:18.386250 ip-10-0-129-135 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 02:01:18.386250 ip-10-0-129-135 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 02:01:18.386250 ip-10-0-129-135 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 02:01:18.386250 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.213137    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 02:01:18.386250 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221667    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 02:01:18.386250 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221689    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 02:01:18.386250 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221693    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 02:01:18.386250 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221696    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 02:01:18.386250 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221700    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 02:01:18.386250 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221702    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 02:01:18.386250 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221705    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 02:01:18.386250 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221708    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 02:01:18.293875 ip-10-0-129-135 systemd[1]: Started Kubernetes Kubelet.
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221711    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221714    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221716    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221719    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221722    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221725    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221727    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221730    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221733    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221735    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221738    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221741    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221743    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221745    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221748    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221750    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221753    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221755    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221758    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 02:01:18.393802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221761    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221763    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221766    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221768    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221771    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221777    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221782    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221786    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221788    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221791    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221794    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221796    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221799    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221802    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221804    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221807    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221809    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221812    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221815    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 02:01:18.402155 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221817    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221820    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221823    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221826    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221828    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221831    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221834    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221836    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221839    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221842    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221844    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221847    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221849    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221851    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221854    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221857    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221859    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221862    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221865    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221869    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 02:01:18.403111 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221872    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221875    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221877    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221880    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221883    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221886    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221890    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221893    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221896    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221899    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221902    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221904    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221907    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221909    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221912    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221915    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221918    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221920    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221924    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 02:01:18.403810 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221926    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221929    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221933    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221936    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221939    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221941    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221944    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221946    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221950    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221953    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221955    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221957    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221960    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.221963    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222736    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222744    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222747    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222750    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222753    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 02:01:18.404404 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222756    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222759    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222762    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222764    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222767    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222770    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222772    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222775    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222777    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222781    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222784    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222786    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222789    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222792    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222796    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222800    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222802    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222809    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222813    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 02:01:18.405137 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222815    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222818    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222821    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222824    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222827    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222830    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222833    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222836    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222838    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222841    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222843    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222846    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222849    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222851    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222854    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222857    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222860    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222863    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222865    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222870    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 02:01:18.405760 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222873    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222875    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222880    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222883    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222886    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222889    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222892    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222894    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222897    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222900    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222904    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222907    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222909    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222912    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222915    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222917    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222920    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222922    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222925    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 02:01:18.406330 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222928    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222930    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222934    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222937    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222939    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222942    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222944    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222947    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222949    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222952    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222955    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222957    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222961    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222963    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222966    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222969    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222971    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222973    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222977    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222980    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 02:01:18.406940 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222984    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222987    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222989    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222993    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222996    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.222998    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223001    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223004    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223007    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223009    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223012    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223014    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223017    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223019    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223022    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223025    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223454    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223460    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223465    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 02:01:18.407556 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223469    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223472    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223488    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223492    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223495    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223500    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223503    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223506    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223509    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223512    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223515    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223518    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223522    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223525    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223528    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223531    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223536    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223539    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223543    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 02:01:18.408141 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223546    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223549    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223552    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223554    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223557    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223559    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223562    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223565    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223568    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223570    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223573    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223576    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223579    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223581    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223584    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223587    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223589    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223592    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223596    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223598    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 02:01:18.408752 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223600    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223603    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223605    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223608    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223610    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223613    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223616    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223619    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223621    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223625    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223628    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223630    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223633    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223636    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223639    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223641    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223644    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223646    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223649    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223652    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 02:01:18.409348 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223654    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223657    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223659    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223662    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223665    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223667    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223669    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223672    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223675    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223677    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223681    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223684    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223687    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223689    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223692    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223694    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223697    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223699    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223702    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223704    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 02:01:18.409901 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223707    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223711    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223714    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223717    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223719    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223723    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223726    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223728    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223731    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223733    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223736    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223739    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223741    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223744    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223747    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223750    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.223752    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223838    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223854    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223860    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223865    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 02:01:18.410524 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223869    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223874    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223878    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223883    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223886    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223889    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223893    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223896    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223899    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223902    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223905    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223908    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223914    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223917    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223923    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223926    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223929    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223932    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223936    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223940    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223943    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223947    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223950    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223954    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 02:01:18.411071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223957    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223960    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223964    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223967    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223971    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223974    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223978    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223980    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223983    2563 flags.go:64] FLAG: --enable-server="true"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223987    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223993    2563 flags.go:64] FLAG: --event-burst="100"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223996    2563 flags.go:64] FLAG: --event-qps="50"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.223999    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224002    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224005    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224009    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224012    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224016    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224019    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224022    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224026    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224030    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224033    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224036    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224039    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 02:01:18.621239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224042    2563 flags.go:64] FLAG: --feature-gates=""
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224046    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224049    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224053    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224056    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224059    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224062    2563 flags.go:64] FLAG: --help="false"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224065    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-129-135.ec2.internal"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224068    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224071    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224074    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224077    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224081    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224084    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224087    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224090    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224095    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224097    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224101    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224104    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224107    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224109    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224113    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224116    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 02:01:18.622341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224119    2563 flags.go:64] FLAG: --lock-file=""
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224121    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224124    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224129    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224135    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224138    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224141    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224144    2563 flags.go:64] FLAG: --logging-format="text"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224147    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224150    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224153    2563 flags.go:64] FLAG: --manifest-url=""
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224156    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224161    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224164    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224168    2563 flags.go:64] FLAG: --max-pods="110"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224171    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224174    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224177    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224180    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224183    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224186    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224189    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224197    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224200    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224205    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 02:01:18.623151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224208    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224211    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224217    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224219    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224223    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224226    2563 flags.go:64] FLAG: --port="10250"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224229    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224232    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01a35c4f464a12b06"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224235    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224239    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224242    2563 flags.go:64] FLAG: --register-node="true"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224246    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224250    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224253    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224257    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224260    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224263    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224267    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224270    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224273    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224276    2563 flags.go:64] FLAG: --runonce="false"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224279    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224282    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224285    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224288    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 02:01:18.623832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224291    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224294    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224297    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224300    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224303    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224306    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224311    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224314    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224317    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224320    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224323    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224328    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224331    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224334    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224339    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224342    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224345    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224348    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224352    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224356    2563 flags.go:64] FLAG: --v="2"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224360    2563 flags.go:64] FLAG: --version="false"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224365    2563 flags.go:64] FLAG: --vmodule=""
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224369    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.224372    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224503    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 02:01:18.624585 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224508    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224511    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224515    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224518    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224521    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224524    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224529    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224533    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224536    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224539    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224542    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224545    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224548    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224552    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224554    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224557    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224560    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224562    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224565    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 02:01:18.625600 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224568    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224570    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224573    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224575    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224578    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224581    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224585    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224587    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224590    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224593    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224596    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224599    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224602    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224604    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224607    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224610    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224612    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224615    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224618    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224620    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 02:01:18.626158 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224623    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224625    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224628    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224631    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224634    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224636    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224640    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224643    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224645    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224648    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224651    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224654    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224656    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224659    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224663    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224666    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224669    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224672    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224677    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 02:01:20.276862 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224679    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224682    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224685    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224688    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224692    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224694    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224697    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224700    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224703    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224706    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224709    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224712    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224715    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224718    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224720    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224723    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224726    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224729    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224732    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224736    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 02:01:20.277785 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224738    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224741    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224744    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224747    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224751    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224755    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224758    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224761    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224763    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224766    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224768    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224772    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224775    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224778    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224780    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224783    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224785    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224789    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224792    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 02:01:20.278435 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.224794    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 02:01:20.279006 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.225580    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 02:01:20.279006 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.234226    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 02:01:20.279006 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.234258    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 02:01:20.279006 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.235118    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 02:01:20.279006 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.235130    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 02:01:20.279006 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235224    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 02:01:20.279006 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235234    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 02:01:20.279006 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235240    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 02:01:20.279006 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235244    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 02:01:20.279006 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235249    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 02:01:20.279006 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235254    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 02:01:20.279006 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235259    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 02:01:20.279006 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235263    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 02:01:20.279006 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235269    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 02:01:20.279006 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235273    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235278    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235284    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235288    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235292    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235296    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235300    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235304    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235308    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235311    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235319    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235323    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235327    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235331    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235335    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235340    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235344    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235349    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235353    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235357    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 02:01:20.279454 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235370    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235374    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235378    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235382    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235386    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235390    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235394    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235397    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235401    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235405    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235409    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235413    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235417    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235421    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235425    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235429    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235432    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235439    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235445    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 02:01:20.280018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235449    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235453    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235457    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235463    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235468    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235472    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235492    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235497    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235501    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235505    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235509    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235512    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235516    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235521    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235526    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235530    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235534    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235537    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235541    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 02:01:20.280546 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235545    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235549    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235553    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235557    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235561    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235564    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235569    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235573    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235576    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235579    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235584    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235588    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235592    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235596    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235600    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235604    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235612    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235615    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235619    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235624    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 02:01:20.281109 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235627    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 02:01:20.281976 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235633    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 02:01:20.281976 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235639    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 02:01:20.281976 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235643    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 02:01:20.281976 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235647    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 02:01:20.281976 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235651    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 02:01:20.281976 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235655    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 02:01:20.281976 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235659    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 02:01:20.281976 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235664    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 02:01:20.281976 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235669    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 02:01:20.281976 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235675    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 02:01:20.281976 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235680    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 02:01:20.281976 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.235688    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 02:01:20.281976 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235867    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 02:01:20.281976 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235875    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235878    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235882    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235887    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235891    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235895    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235899    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235905    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235910    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235914    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235919    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235923    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235927    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235931    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235937    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235943    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235948    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235953    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235957    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 02:01:20.282794 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235961    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235965    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235969    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235972    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235976    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235980    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235984    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235988    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235993    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.235997    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236000    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236004    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236008    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236012    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236016    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236020    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236023    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236027    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236031    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 02:01:20.283610 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236035    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236039    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236043    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236047    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236050    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236055    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236058    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236062    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236068    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236073    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236077    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236081    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236085    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236088    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236092    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236096    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236100    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236105    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236108    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236112    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236116    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 02:01:20.284420 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236120    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236126    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236130    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236134    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236137    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236141    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236145    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236149    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236153    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236157    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236160    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236165    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236169    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236173    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236179    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236183    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236188    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236192    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236196    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236204    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 02:01:20.284969 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236209    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236214    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236218    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236222    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236226    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236230    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236234    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236238    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236243    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236247    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236251    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236255    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236259    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236263    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236268    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236272    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236276    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236280    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 02:01:20.285564 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:18.236284    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 02:01:20.286033 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.236291    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 02:01:20.286033 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.236503    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 02:01:20.286033 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.239424    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 02:01:20.286033 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.241071    2563 server.go:1019] "Starting client certificate rotation"
Jul 14 02:01:20.286033 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.241182    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 02:01:20.286033 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.241224    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 02:01:20.286033 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.243992    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 02:01:20.286033 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.248260    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 02:01:20.286033 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.259921    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 14 02:01:20.286033 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.262421    2563 log.go:25] "Validated CRI v1 image API"
Jul 14 02:01:20.286033 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.263321    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 02:01:20.286033 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.268128    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 02:01:20.286434 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.269565    2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7ff9f4c9-2839-498c-bb80-9863f91adb33:/dev/nvme0n1p3 e0a34380-fc09-45aa-b396-5f15f7355643:/dev/nvme0n1p4]
Jul 14 02:01:20.286434 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.269585    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.274670    2563 manager.go:216] Machine: {Timestamp:2026-07-14 02:01:18.274164152 +0000 UTC m=+0.386424541 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098479 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec291e84b8c0c7ebf725bae0b320975a SystemUUID:ec291e84-b8c0-c7eb-f725-bae0b320975a BootID:d2b0094f-4327-4797-ab5f-bde06d7f03a6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:82:1e:44:58:af Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:82:1e:44:58:af Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:1e:70:ef:47:0d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.274776    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.274868    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.277606    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.277639    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-135.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.278505    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.278518    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.278525    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.278540    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.279781    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.283240    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.283395    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.283425    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.283438    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.283457    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.283470    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.283498    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 02:01:20.286604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.283939    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.283956    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.286637    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.288576    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.288605    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.289428    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.289442    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.289448    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.289454    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.289462    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.289468    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.289492    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.289498    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.289506    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.289512    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.289521    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.289527    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.289552    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.289557    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.292761    2563 server.go:1268] "Started kubelet"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.292986    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.293441    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.293455    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.294940    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.295296    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-135.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.295310    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.295310    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.297934    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.301752    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.300953    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-135.ec2.internal.18c20586a7e58c52  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-135.ec2.internal,UID:ip-10-0-129-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-135.ec2.internal,},FirstTimestamp:2026-07-14 02:01:18.29273301 +0000 UTC m=+0.404993380,LastTimestamp:2026-07-14 02:01:18.29273301 +0000 UTC m=+0.404993380,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-135.ec2.internal,}"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.302695    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.302712    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.302812    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.303510    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.303582    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.303597    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.303695    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.303704    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.303792    2563 factory.go:153] Registering CRI-O factory
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.303809    2563 factory.go:223] Registration of the crio container factory successfully
Jul 14 02:01:20.287122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.303862    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.303877    2563 factory.go:55] Registering systemd factory
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.303885    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.303910    2563 factory.go:103] Registering Raw factory
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.303926    2563 manager.go:1196] Started watching for new ooms in manager
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.304352    2563 manager.go:349] Starting recovery of all containers
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.310210    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.310338    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.315196    2563 manager.go:354] Recovery completed
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.321697    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.324034    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.324066    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.324077    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientPID"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.324691    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.324700    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.324709    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.324720    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.325491    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.325519    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.325531    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientPID"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.326193    2563 policy_none.go:49] "None policy: Start"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.326210    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.326244    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.326276    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-135.ec2.internal.18c20586a9c36990  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-135.ec2.internal,UID:ip-10-0-129-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-135.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-135.ec2.internal,},FirstTimestamp:2026-07-14 02:01:18.32405032 +0000 UTC m=+0.436310689,LastTimestamp:2026-07-14 02:01:18.32405032 +0000 UTC m=+0.436310689,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-135.ec2.internal,}"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.327152    2563 policy_none.go:47] "Start"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.328985    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jj4hk"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.334607    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-135.ec2.internal.18c20586a9c3b9c3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-135.ec2.internal,UID:ip-10-0-129-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-135.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-135.ec2.internal,},FirstTimestamp:2026-07-14 02:01:18.324070851 +0000 UTC m=+0.436331220,LastTimestamp:2026-07-14 02:01:18.324070851 +0000 UTC m=+0.436331220,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-135.ec2.internal,}"
Jul 14 02:01:20.288212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.336087    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jj4hk"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.336471    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-135.ec2.internal.18c20586a9c3e283  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-135.ec2.internal,UID:ip-10-0-129-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-135.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-135.ec2.internal,},FirstTimestamp:2026-07-14 02:01:18.324081283 +0000 UTC m=+0.436341651,LastTimestamp:2026-07-14 02:01:18.324081283 +0000 UTC m=+0.436341651,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-135.ec2.internal,}"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.365156    2563 manager.go:337] "Starting Device Plugin manager"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.365188    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.365198    2563 server.go:87] "Starting device plugin registration server"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.365516    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.365530    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.365618    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.365702    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.365711    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.366401    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.366449    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.415269    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.418796    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.418843    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.418875    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.418920    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.421472    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.466555    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.467524    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.467560    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.467573    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientPID"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.467596    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.481206    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.481236    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-135.ec2.internal\": node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.502268    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.519182    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-135.ec2.internal"]
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.519264    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.523622    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.523658    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.523668    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientPID"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.524888    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.524983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.525011    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.525733    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.525764    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.525777    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientPID"
Jul 14 02:01:20.289449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.525783    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.525800    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.525809    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientPID"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.527074    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.527103    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.527846    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.527869    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.527879    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientPID"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.560470    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-135.ec2.internal\" not found" node="ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.564791    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-135.ec2.internal\" not found" node="ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.602645    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.605928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f97932cbaba467da7a20029d884172d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal\" (UID: \"6f97932cbaba467da7a20029d884172d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.605958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/642dbee9eb2272032636e1b0ef1491d1-config\") pod \"kube-apiserver-proxy-ip-10-0-129-135.ec2.internal\" (UID: \"642dbee9eb2272032636e1b0ef1491d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.605978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6f97932cbaba467da7a20029d884172d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal\" (UID: \"6f97932cbaba467da7a20029d884172d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:18.703110    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.706335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/642dbee9eb2272032636e1b0ef1491d1-config\") pod \"kube-apiserver-proxy-ip-10-0-129-135.ec2.internal\" (UID: \"642dbee9eb2272032636e1b0ef1491d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.706371    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6f97932cbaba467da7a20029d884172d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal\" (UID: \"6f97932cbaba467da7a20029d884172d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.706390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f97932cbaba467da7a20029d884172d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal\" (UID: \"6f97932cbaba467da7a20029d884172d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.706433    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f97932cbaba467da7a20029d884172d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal\" (UID: \"6f97932cbaba467da7a20029d884172d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.706448    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/642dbee9eb2272032636e1b0ef1491d1-config\") pod \"kube-apiserver-proxy-ip-10-0-129-135.ec2.internal\" (UID: \"642dbee9eb2272032636e1b0ef1491d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:18.706454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6f97932cbaba467da7a20029d884172d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal\" (UID: \"6f97932cbaba467da7a20029d884172d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.290500 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:20.233877    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:20.496109 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:20.292198    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.496109 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:20.296857    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-135.ec2.internal"
Jul 14 02:01:20.496109 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:20.334642    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:20.496109 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:20.435115    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:20.648077 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:20.535613    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:20.648077 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:20.636295    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:20.811944 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:20.669543    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 02:01:20.811944 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:20.669709    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 02:01:20.811944 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:20.737199    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:20.811944 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:20.755854    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 02:01:20.811944 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:20.770227    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 01:56:19 +0000 UTC" deadline="2028-01-12 23:48:29.901922729 +0000 UTC"
Jul 14 02:01:20.811944 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:20.770275    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13149h47m9.131653228s"
Jul 14 02:01:20.959792 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:20.835026    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod642dbee9eb2272032636e1b0ef1491d1.slice/crio-a35d652843dbd5af121a2a3b556271832f10c41b6e6104f8d895c29cb9cee6f1 WatchSource:0}: Error finding container a35d652843dbd5af121a2a3b556271832f10c41b6e6104f8d895c29cb9cee6f1: Status 404 returned error can't find the container with id a35d652843dbd5af121a2a3b556271832f10c41b6e6104f8d895c29cb9cee6f1
Jul 14 02:01:20.959792 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:20.838227    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:20.959792 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:20.841402    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 02:01:20.959792 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:20.852673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal" event={"ID":"6f97932cbaba467da7a20029d884172d","Type":"ContainerStarted","Data":"5038dcad14b056967f152b15dd489d645b885b1a91534e4816f68d3860c2a3dd"}
Jul 14 02:01:20.959792 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:20.853601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-135.ec2.internal" event={"ID":"642dbee9eb2272032636e1b0ef1491d1","Type":"ContainerStarted","Data":"a35d652843dbd5af121a2a3b556271832f10c41b6e6104f8d895c29cb9cee6f1"}
Jul 14 02:01:20.959792 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:20.941590    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:20.959792 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:20.941703    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 02:01:21.120069 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:20.963879    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 02:01:21.120069 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:20.965121    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 02:01:21.120069 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:20.965158    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 02:01:21.120069 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:20.965186    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeHasSufficientPID"
Jul 14 02:01:21.120069 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:21.042097    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:21.274966 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:21.142484    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-135.ec2.internal\" not found"
Jul 14 02:01:21.274966 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.186477    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 02:01:21.274966 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.232793    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal"
Jul 14 02:01:21.274966 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.245674    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 02:01:21.274966 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.246806    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-135.ec2.internal"
Jul 14 02:01:21.274966 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.255125    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.714403    2563 apiserver.go:52] "Watching apiserver"
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.724196    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.725542    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-58548","kube-system/konnectivity-agent-q56rq","openshift-cluster-node-tuning-operator/tuned-r9qbr","openshift-image-registry/node-ca-7ftxk","openshift-multus/multus-additional-cni-plugins-ffrf7","openshift-multus/network-metrics-daemon-wnrxm","openshift-network-diagnostics/network-check-target-kwm2d","openshift-ovn-kubernetes/ovnkube-node-l4xnb","kube-system/kube-apiserver-proxy-ip-10-0-129-135.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm","openshift-dns/node-resolver-tqxqv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal","openshift-multus/multus-d2vht","openshift-network-operator/iptables-alerter-lrr5s"]
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.727366    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.728541    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lrr5s"
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.729252    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:21.729320    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.730354    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.730687    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bkwgl\""
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.730880    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.731221    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.731468    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.731614    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7ftxk"
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.732382    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.732680    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.733741    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9fhrl\""
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.733991    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.734051    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:21.734052    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.734229    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:21.734292    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.734479    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.734515    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5r6pp\""
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.734755    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.734885    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.734900    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.735080    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jmbj7\""
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.735203    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.735254    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 02:01:21.808717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.735373    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.735642    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.737546    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.739405    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.740386    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.740596    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.740761    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.740901    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.741037    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.741220    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f6p4h\""
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.741735    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.742034    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.742062    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-74h9l\""
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.742263    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.742347    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.743737    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tqxqv"
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745197    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-systemd\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c2xc\" (UniqueName: \"kubernetes.io/projected/1e87de01-8c13-4fbb-aa19-c08817fda86b-kube-api-access-4c2xc\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-var-lib-openvswitch\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745315    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-cni-bin\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce00aadc-7129-4a4b-be2d-857793cd0566-host-slash\") pod \"iptables-alerter-lrr5s\" (UID: \"ce00aadc-7129-4a4b-be2d-857793cd0566\") " pod="openshift-network-operator/iptables-alerter-lrr5s"
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745400    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db745a62-430b-4b46-906f-761da9b8cdbe-host\") pod \"node-ca-7ftxk\" (UID: \"db745a62-430b-4b46-906f-761da9b8cdbe\") " pod="openshift-image-registry/node-ca-7ftxk"
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db745a62-430b-4b46-906f-761da9b8cdbe-serviceca\") pod \"node-ca-7ftxk\" (UID: \"db745a62-430b-4b46-906f-761da9b8cdbe\") " pod="openshift-image-registry/node-ca-7ftxk"
Jul 14 02:01:21.811815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745445    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvphp\" (UniqueName: \"kubernetes.io/projected/db745a62-430b-4b46-906f-761da9b8cdbe-kube-api-access-rvphp\") pod \"node-ca-7ftxk\" (UID: \"db745a62-430b-4b46-906f-761da9b8cdbe\") " pod="openshift-image-registry/node-ca-7ftxk"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a53a3ae2-0828-49a1-b4dd-e352caae8834-ovnkube-script-lib\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-sysctl-conf\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-cni-netd\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745582    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-modprobe-d\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-systemd-units\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-etc-openvswitch\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-run-openvswitch\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745692    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-node-log\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745717    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-run-ovn-kubernetes\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745751    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ca207ce-6644-4908-b414-240bccf75bd0-system-cni-dir\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-host\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745828    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-run-netns\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745850    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txm9d\" (UniqueName: \"kubernetes.io/projected/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-kube-api-access-txm9d\") pod \"network-metrics-daemon-wnrxm\" (UID: \"cf6bc5ea-e0e1-415d-b47a-19bc897a699c\") " pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-run-systemd\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745972    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ca207ce-6644-4908-b414-240bccf75bd0-cni-binary-copy\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.815599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.745999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ca207ce-6644-4908-b414-240bccf75bd0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a53a3ae2-0828-49a1-b4dd-e352caae8834-ovn-node-metrics-cert\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-sys\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e87de01-8c13-4fbb-aa19-c08817fda86b-tmp\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68066f26-c4d5-4b49-8e00-88afb1882a06-dbus\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-log-socket\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746443    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q56rq"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a53a3ae2-0828-49a1-b4dd-e352caae8834-env-overrides\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746655    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-kubernetes\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-run\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k429n\" (UniqueName: \"kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n\") pod \"network-check-target-kwm2d\" (UID: \"73be1377-1b11-4b2f-b6bf-f27e04d7f3df\") " pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22tbd\" (UniqueName: \"kubernetes.io/projected/2ca207ce-6644-4908-b414-240bccf75bd0-kube-api-access-22tbd\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746752    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs\") pod \"network-metrics-daemon-wnrxm\" (UID: \"cf6bc5ea-e0e1-415d-b47a-19bc897a699c\") " pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-slash\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgdww\" (UniqueName: \"kubernetes.io/projected/a53a3ae2-0828-49a1-b4dd-e352caae8834-kube-api-access-sgdww\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ce00aadc-7129-4a4b-be2d-857793cd0566-iptables-alerter-script\") pod \"iptables-alerter-lrr5s\" (UID: \"ce00aadc-7129-4a4b-be2d-857793cd0566\") " pod="openshift-network-operator/iptables-alerter-lrr5s"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-run-ovn\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.817531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.746984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-var-lib-kubelet\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747038    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-tuned\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747063    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ca207ce-6644-4908-b414-240bccf75bd0-os-release\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747223    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-kubelet\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747332    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ca207ce-6644-4908-b414-240bccf75bd0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747368    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2hcl\" (UniqueName: \"kubernetes.io/projected/ce00aadc-7129-4a4b-be2d-857793cd0566-kube-api-access-d2hcl\") pod \"iptables-alerter-lrr5s\" (UID: \"ce00aadc-7129-4a4b-be2d-857793cd0566\") " pod="openshift-network-operator/iptables-alerter-lrr5s"
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a53a3ae2-0828-49a1-b4dd-e352caae8834-ovnkube-config\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747438    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-sysconfig\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747470    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-sysctl-d\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-lib-modules\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68066f26-c4d5-4b49-8e00-88afb1882a06-kubelet-config\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747585    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ca207ce-6644-4908-b414-240bccf75bd0-cnibin\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ca207ce-6644-4908-b414-240bccf75bd0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747669    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.747829    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.750161    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f47w5\""
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.750381    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d26rw\""
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.750718    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.750853    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bb4ff\""
Jul 14 02:01:21.818633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.750941    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 02:01:21.820569 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.753288    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 02:01:21.820569 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.814179    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-czvd8"
Jul 14 02:01:21.820569 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.814204    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-czvd8"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.834136    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848019    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-sys\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848061    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e87de01-8c13-4fbb-aa19-c08817fda86b-tmp\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68066f26-c4d5-4b49-8e00-88afb1882a06-dbus\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848118    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-log-socket\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a53a3ae2-0828-49a1-b4dd-e352caae8834-env-overrides\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848191    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848207    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-log-socket\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848212    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-socket-dir\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848261    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-kubernetes\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-run\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848312    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k429n\" (UniqueName: \"kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n\") pod \"network-check-target-kwm2d\" (UID: \"73be1377-1b11-4b2f-b6bf-f27e04d7f3df\") " pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848338    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22tbd\" (UniqueName: \"kubernetes.io/projected/2ca207ce-6644-4908-b414-240bccf75bd0-kube-api-access-22tbd\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848359    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68066f26-c4d5-4b49-8e00-88afb1882a06-dbus\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs\") pod \"network-metrics-daemon-wnrxm\" (UID: \"cf6bc5ea-e0e1-415d-b47a-19bc897a699c\") " pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-cnibin\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848434    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-slash\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.893451 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:21.848451    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgdww\" (UniqueName: \"kubernetes.io/projected/a53a3ae2-0828-49a1-b4dd-e352caae8834-kube-api-access-sgdww\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848474    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:21.848520    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs podName:cf6bc5ea-e0e1-415d-b47a-19bc897a699c nodeName:}" failed. No retries permitted until 2026-07-14 02:01:22.348494917 +0000 UTC m=+3.031065738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs") pod "network-metrics-daemon-wnrxm" (UID: "cf6bc5ea-e0e1-415d-b47a-19bc897a699c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848546    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-slash\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848569    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-kubernetes\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848750    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a53a3ae2-0828-49a1-b4dd-e352caae8834-env-overrides\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848144    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-sys\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848864    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-run\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.848481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-var-lib-kubelet\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ce00aadc-7129-4a4b-be2d-857793cd0566-iptables-alerter-script\") pod \"iptables-alerter-lrr5s\" (UID: \"ce00aadc-7129-4a4b-be2d-857793cd0566\") " pod="openshift-network-operator/iptables-alerter-lrr5s"
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-multus-conf-dir\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849083    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-run-multus-certs\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcq2f\" (UniqueName: \"kubernetes.io/projected/08a91a1c-3798-4615-86e2-e4213dac2b59-kube-api-access-tcq2f\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849128    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1aa6070-2304-452d-957f-1fe1833526af-konnectivity-ca\") pod \"konnectivity-agent-q56rq\" (UID: \"a1aa6070-2304-452d-957f-1fe1833526af\") " pod="kube-system/konnectivity-agent-q56rq"
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n946l\" (UniqueName: \"kubernetes.io/projected/08411450-7e59-47d7-86fd-a9df899dc964-kube-api-access-n946l\") pod \"node-resolver-tqxqv\" (UID: \"08411450-7e59-47d7-86fd-a9df899dc964\") " pod="openshift-dns/node-resolver-tqxqv"
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849186    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-run-ovn\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.896032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849210    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-run-k8s-cni-cncf-io\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-var-lib-cni-multus\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-var-lib-kubelet\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-tuned\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ca207ce-6644-4908-b414-240bccf75bd0-os-release\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-device-dir\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849348    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1aa6070-2304-452d-957f-1fe1833526af-agent-certs\") pod \"konnectivity-agent-q56rq\" (UID: \"a1aa6070-2304-452d-957f-1fe1833526af\") " pod="kube-system/konnectivity-agent-q56rq"
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849370    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08411450-7e59-47d7-86fd-a9df899dc964-tmp-dir\") pod \"node-resolver-tqxqv\" (UID: \"08411450-7e59-47d7-86fd-a9df899dc964\") " pod="openshift-dns/node-resolver-tqxqv"
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-kubelet\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849458    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-run-ovn\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:21.849490    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849528    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ca207ce-6644-4908-b414-240bccf75bd0-os-release\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:21.849537    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret podName:68066f26-c4d5-4b49-8e00-88afb1882a06 nodeName:}" failed. No retries permitted until 2026-07-14 02:01:22.349522922 +0000 UTC m=+3.032093736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret") pod "global-pull-secret-syncer-58548" (UID: "68066f26-c4d5-4b49-8e00-88afb1882a06") : object "kube-system"/"original-pull-secret" not registered
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ca207ce-6644-4908-b414-240bccf75bd0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ce00aadc-7129-4a4b-be2d-857793cd0566-iptables-alerter-script\") pod \"iptables-alerter-lrr5s\" (UID: \"ce00aadc-7129-4a4b-be2d-857793cd0566\") " pod="openshift-network-operator/iptables-alerter-lrr5s"
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849599    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-kubelet\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.896887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849595    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-var-lib-kubelet\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-registration-dir\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hhsb\" (UniqueName: \"kubernetes.io/projected/14d7265f-5e88-4719-ace1-06813f73041e-kube-api-access-2hhsb\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2hcl\" (UniqueName: \"kubernetes.io/projected/ce00aadc-7129-4a4b-be2d-857793cd0566-kube-api-access-d2hcl\") pod \"iptables-alerter-lrr5s\" (UID: \"ce00aadc-7129-4a4b-be2d-857793cd0566\") " pod="openshift-network-operator/iptables-alerter-lrr5s"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849773    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a53a3ae2-0828-49a1-b4dd-e352caae8834-ovnkube-config\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-sysconfig\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849815    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-sysctl-d\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849837    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-lib-modules\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68066f26-c4d5-4b49-8e00-88afb1882a06-kubelet-config\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ca207ce-6644-4908-b414-240bccf75bd0-cnibin\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ca207ce-6644-4908-b414-240bccf75bd0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-sys-fs\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.849979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-etc-kubernetes\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850004    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-systemd\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c2xc\" (UniqueName: \"kubernetes.io/projected/1e87de01-8c13-4fbb-aa19-c08817fda86b-kube-api-access-4c2xc\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-var-lib-openvswitch\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.898813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850134    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-cni-bin\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850191    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ca207ce-6644-4908-b414-240bccf75bd0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce00aadc-7129-4a4b-be2d-857793cd0566-host-slash\") pod \"iptables-alerter-lrr5s\" (UID: \"ce00aadc-7129-4a4b-be2d-857793cd0566\") " pod="openshift-network-operator/iptables-alerter-lrr5s"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db745a62-430b-4b46-906f-761da9b8cdbe-host\") pod \"node-ca-7ftxk\" (UID: \"db745a62-430b-4b46-906f-761da9b8cdbe\") " pod="openshift-image-registry/node-ca-7ftxk"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db745a62-430b-4b46-906f-761da9b8cdbe-serviceca\") pod \"node-ca-7ftxk\" (UID: \"db745a62-430b-4b46-906f-761da9b8cdbe\") " pod="openshift-image-registry/node-ca-7ftxk"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850320    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvphp\" (UniqueName: \"kubernetes.io/projected/db745a62-430b-4b46-906f-761da9b8cdbe-kube-api-access-rvphp\") pod \"node-ca-7ftxk\" (UID: \"db745a62-430b-4b46-906f-761da9b8cdbe\") " pod="openshift-image-registry/node-ca-7ftxk"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a53a3ae2-0828-49a1-b4dd-e352caae8834-ovnkube-script-lib\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850370    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-multus-cni-dir\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850342    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a53a3ae2-0828-49a1-b4dd-e352caae8834-ovnkube-config\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850464    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-sysconfig\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-run-netns\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-sysctl-conf\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-cni-netd\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-modprobe-d\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850606    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-systemd-units\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-etc-openvswitch\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.899689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-run-openvswitch\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-node-log\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850707    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68066f26-c4d5-4b49-8e00-88afb1882a06-kubelet-config\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850717    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ca207ce-6644-4908-b414-240bccf75bd0-cnibin\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-run-ovn-kubernetes\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850769    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-run-ovn-kubernetes\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-systemd\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850804    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db745a62-430b-4b46-906f-761da9b8cdbe-host\") pod \"node-ca-7ftxk\" (UID: \"db745a62-430b-4b46-906f-761da9b8cdbe\") " pod="openshift-image-registry/node-ca-7ftxk"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ca207ce-6644-4908-b414-240bccf75bd0-system-cni-dir\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850830    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-sysctl-d\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850836    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-var-lib-openvswitch\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08a91a1c-3798-4615-86e2-e4213dac2b59-multus-daemon-config\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-host\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850892    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce00aadc-7129-4a4b-be2d-857793cd0566-host-slash\") pod \"iptables-alerter-lrr5s\" (UID: \"ce00aadc-7129-4a4b-be2d-857793cd0566\") " pod="openshift-network-operator/iptables-alerter-lrr5s"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850891    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a53a3ae2-0828-49a1-b4dd-e352caae8834-ovnkube-script-lib\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850915    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-run-netns\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.850960    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-cni-bin\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851001    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-host\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.902690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-lib-modules\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851043    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-run-openvswitch\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-systemd-units\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-run-netns\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851095    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-cni-netd\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851112    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-etc-openvswitch\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-node-log\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txm9d\" (UniqueName: \"kubernetes.io/projected/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-kube-api-access-txm9d\") pod \"network-metrics-daemon-wnrxm\" (UID: \"cf6bc5ea-e0e1-415d-b47a-19bc897a699c\") " pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851203    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-modprobe-d\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851222    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-sysctl-conf\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851245    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-var-lib-cni-bin\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851271    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08411450-7e59-47d7-86fd-a9df899dc964-hosts-file\") pod \"node-resolver-tqxqv\" (UID: \"08411450-7e59-47d7-86fd-a9df899dc964\") " pod="openshift-dns/node-resolver-tqxqv"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851308    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ca207ce-6644-4908-b414-240bccf75bd0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db745a62-430b-4b46-906f-761da9b8cdbe-serviceca\") pod \"node-ca-7ftxk\" (UID: \"db745a62-430b-4b46-906f-761da9b8cdbe\") " pod="openshift-image-registry/node-ca-7ftxk"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-run-systemd\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851414    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ca207ce-6644-4908-b414-240bccf75bd0-system-cni-dir\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.903581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851447    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ca207ce-6644-4908-b414-240bccf75bd0-cni-binary-copy\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851477    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ca207ce-6644-4908-b414-240bccf75bd0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851504    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a53a3ae2-0828-49a1-b4dd-e352caae8834-run-systemd\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-etc-selinux\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08a91a1c-3798-4615-86e2-e4213dac2b59-cni-binary-copy\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-hostroot\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a53a3ae2-0828-49a1-b4dd-e352caae8834-ovn-node-metrics-cert\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851666    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ca207ce-6644-4908-b414-240bccf75bd0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-system-cni-dir\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851696    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-os-release\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.851722    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-multus-socket-dir-parent\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.852373    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ca207ce-6644-4908-b414-240bccf75bd0-cni-binary-copy\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:21.855377    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:21.855397    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:21.855409    2563 projected.go:196] Error preparing data for projected volume kube-api-access-k429n for pod openshift-network-diagnostics/network-check-target-kwm2d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:21.855502    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n podName:73be1377-1b11-4b2f-b6bf-f27e04d7f3df nodeName:}" failed. No retries permitted until 2026-07-14 02:01:22.355486041 +0000 UTC m=+3.038056855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k429n" (UniqueName: "kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n") pod "network-check-target-kwm2d" (UID: "73be1377-1b11-4b2f-b6bf-f27e04d7f3df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.855585    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a53a3ae2-0828-49a1-b4dd-e352caae8834-ovn-node-metrics-cert\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.906379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.857238    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e87de01-8c13-4fbb-aa19-c08817fda86b-etc-tuned\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.907048 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.857769    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e87de01-8c13-4fbb-aa19-c08817fda86b-tmp\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.907048 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.860074    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c2xc\" (UniqueName: \"kubernetes.io/projected/1e87de01-8c13-4fbb-aa19-c08817fda86b-kube-api-access-4c2xc\") pod \"tuned-r9qbr\" (UID: \"1e87de01-8c13-4fbb-aa19-c08817fda86b\") " pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:21.907048 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.860568    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txm9d\" (UniqueName: \"kubernetes.io/projected/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-kube-api-access-txm9d\") pod \"network-metrics-daemon-wnrxm\" (UID: \"cf6bc5ea-e0e1-415d-b47a-19bc897a699c\") " pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:21.907048 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.862386    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgdww\" (UniqueName: \"kubernetes.io/projected/a53a3ae2-0828-49a1-b4dd-e352caae8834-kube-api-access-sgdww\") pod \"ovnkube-node-l4xnb\" (UID: \"a53a3ae2-0828-49a1-b4dd-e352caae8834\") " pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:21.907048 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.862878    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvphp\" (UniqueName: \"kubernetes.io/projected/db745a62-430b-4b46-906f-761da9b8cdbe-kube-api-access-rvphp\") pod \"node-ca-7ftxk\" (UID: \"db745a62-430b-4b46-906f-761da9b8cdbe\") " pod="openshift-image-registry/node-ca-7ftxk"
Jul 14 02:01:21.907048 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.863602    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22tbd\" (UniqueName: \"kubernetes.io/projected/2ca207ce-6644-4908-b414-240bccf75bd0-kube-api-access-22tbd\") pod \"multus-additional-cni-plugins-ffrf7\" (UID: \"2ca207ce-6644-4908-b414-240bccf75bd0\") " pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:21.907048 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.863682    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2hcl\" (UniqueName: \"kubernetes.io/projected/ce00aadc-7129-4a4b-be2d-857793cd0566-kube-api-access-d2hcl\") pod \"iptables-alerter-lrr5s\" (UID: \"ce00aadc-7129-4a4b-be2d-857793cd0566\") " pod="openshift-network-operator/iptables-alerter-lrr5s"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952399    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08a91a1c-3798-4615-86e2-e4213dac2b59-multus-daemon-config\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952446    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-var-lib-cni-bin\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08411450-7e59-47d7-86fd-a9df899dc964-hosts-file\") pod \"node-resolver-tqxqv\" (UID: \"08411450-7e59-47d7-86fd-a9df899dc964\") " pod="openshift-dns/node-resolver-tqxqv"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952514    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-etc-selinux\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-var-lib-cni-bin\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952635    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08a91a1c-3798-4615-86e2-e4213dac2b59-cni-binary-copy\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952650    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-etc-selinux\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952668    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-hostroot\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952706    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08411450-7e59-47d7-86fd-a9df899dc964-hosts-file\") pod \"node-resolver-tqxqv\" (UID: \"08411450-7e59-47d7-86fd-a9df899dc964\") " pod="openshift-dns/node-resolver-tqxqv"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-system-cni-dir\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-os-release\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952764    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-system-cni-dir\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-multus-socket-dir-parent\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-socket-dir\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952873    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-os-release\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952916    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-cnibin\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.024863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-var-lib-kubelet\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-multus-conf-dir\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953020    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-run-multus-certs\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcq2f\" (UniqueName: \"kubernetes.io/projected/08a91a1c-3798-4615-86e2-e4213dac2b59-kube-api-access-tcq2f\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953084    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1aa6070-2304-452d-957f-1fe1833526af-konnectivity-ca\") pod \"konnectivity-agent-q56rq\" (UID: \"a1aa6070-2304-452d-957f-1fe1833526af\") " pod="kube-system/konnectivity-agent-q56rq"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953101    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08a91a1c-3798-4615-86e2-e4213dac2b59-multus-daemon-config\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n946l\" (UniqueName: \"kubernetes.io/projected/08411450-7e59-47d7-86fd-a9df899dc964-kube-api-access-n946l\") pod \"node-resolver-tqxqv\" (UID: \"08411450-7e59-47d7-86fd-a9df899dc964\") " pod="openshift-dns/node-resolver-tqxqv"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-run-k8s-cni-cncf-io\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-var-lib-cni-multus\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-device-dir\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953230    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1aa6070-2304-452d-957f-1fe1833526af-agent-certs\") pod \"konnectivity-agent-q56rq\" (UID: \"a1aa6070-2304-452d-957f-1fe1833526af\") " pod="kube-system/konnectivity-agent-q56rq"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08411450-7e59-47d7-86fd-a9df899dc964-tmp-dir\") pod \"node-resolver-tqxqv\" (UID: \"08411450-7e59-47d7-86fd-a9df899dc964\") " pod="openshift-dns/node-resolver-tqxqv"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-registration-dir\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hhsb\" (UniqueName: \"kubernetes.io/projected/14d7265f-5e88-4719-ace1-06813f73041e-kube-api-access-2hhsb\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953333    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08a91a1c-3798-4615-86e2-e4213dac2b59-cni-binary-copy\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953327    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-hostroot\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.952825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-multus-socket-dir-parent\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-sys-fs\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:22.026783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-etc-kubernetes\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953556    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-device-dir\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-var-lib-cni-multus\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953609    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953635    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-sys-fs\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953539    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-run-k8s-cni-cncf-io\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953568    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-var-lib-kubelet\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.955382    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-multus-conf-dir\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.955620    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08411450-7e59-47d7-86fd-a9df899dc964-tmp-dir\") pod \"node-resolver-tqxqv\" (UID: \"08411450-7e59-47d7-86fd-a9df899dc964\") " pod="openshift-dns/node-resolver-tqxqv"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.956188    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a1aa6070-2304-452d-957f-1fe1833526af-konnectivity-ca\") pod \"konnectivity-agent-q56rq\" (UID: \"a1aa6070-2304-452d-957f-1fe1833526af\") " pod="kube-system/konnectivity-agent-q56rq"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.957706    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-socket-dir\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.958501    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/14d7265f-5e88-4719-ace1-06813f73041e-registration-dir\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.958556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-multus-cni-dir\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.958602    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-run-netns\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.958663    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-multus-cni-dir\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.958703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-run-netns\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.958799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-etc-kubernetes\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.953627    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-host-run-multus-certs\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.030175 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.959120    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08a91a1c-3798-4615-86e2-e4213dac2b59-cnibin\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.031460 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.963280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a1aa6070-2304-452d-957f-1fe1833526af-agent-certs\") pod \"konnectivity-agent-q56rq\" (UID: \"a1aa6070-2304-452d-957f-1fe1833526af\") " pod="kube-system/konnectivity-agent-q56rq"
Jul 14 02:01:22.031460 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.965861    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hhsb\" (UniqueName: \"kubernetes.io/projected/14d7265f-5e88-4719-ace1-06813f73041e-kube-api-access-2hhsb\") pod \"aws-ebs-csi-driver-node-mttnm\" (UID: \"14d7265f-5e88-4719-ace1-06813f73041e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:22.031460 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.966032    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcq2f\" (UniqueName: \"kubernetes.io/projected/08a91a1c-3798-4615-86e2-e4213dac2b59-kube-api-access-tcq2f\") pod \"multus-d2vht\" (UID: \"08a91a1c-3798-4615-86e2-e4213dac2b59\") " pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.031460 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:21.966669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n946l\" (UniqueName: \"kubernetes.io/projected/08411450-7e59-47d7-86fd-a9df899dc964-kube-api-access-n946l\") pod \"node-resolver-tqxqv\" (UID: \"08411450-7e59-47d7-86fd-a9df899dc964\") " pod="openshift-dns/node-resolver-tqxqv"
Jul 14 02:01:22.142941 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.043726    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r9qbr"
Jul 14 02:01:22.142941 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.113084    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lrr5s"
Jul 14 02:01:22.142941 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.123428    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 02:01:22.142941 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.127564    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7ftxk"
Jul 14 02:01:22.142941 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.134259    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ffrf7"
Jul 14 02:01:22.142941 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.139974    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:22.149055 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.147211    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm"
Jul 14 02:01:22.226412 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.157409    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tqxqv"
Jul 14 02:01:22.226412 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.182231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d2vht"
Jul 14 02:01:22.226412 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.189017    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q56rq"
Jul 14 02:01:22.363430 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.363391    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:22.363611 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:22.363551    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 02:01:22.363665 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.363550    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k429n\" (UniqueName: \"kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n\") pod \"network-check-target-kwm2d\" (UID: \"73be1377-1b11-4b2f-b6bf-f27e04d7f3df\") " pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:22.363665 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:22.363631    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret podName:68066f26-c4d5-4b49-8e00-88afb1882a06 nodeName:}" failed. No retries permitted until 2026-07-14 02:01:23.363609943 +0000 UTC m=+4.046180777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret") pod "global-pull-secret-syncer-58548" (UID: "68066f26-c4d5-4b49-8e00-88afb1882a06") : object "kube-system"/"original-pull-secret" not registered
Jul 14 02:01:22.363759 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:22.363663    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 02:01:22.363759 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:22.363686    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 02:01:22.363759 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:22.363696    2563 projected.go:196] Error preparing data for projected volume kube-api-access-k429n for pod openshift-network-diagnostics/network-check-target-kwm2d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 02:01:22.363759 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:22.363732    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 02:01:22.363759 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:22.363744    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n podName:73be1377-1b11-4b2f-b6bf-f27e04d7f3df nodeName:}" failed. No retries permitted until 2026-07-14 02:01:23.363727638 +0000 UTC m=+4.046298478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k429n" (UniqueName: "kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n") pod "network-check-target-kwm2d" (UID: "73be1377-1b11-4b2f-b6bf-f27e04d7f3df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 02:01:22.363759 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.363670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs\") pod \"network-metrics-daemon-wnrxm\" (UID: \"cf6bc5ea-e0e1-415d-b47a-19bc897a699c\") " pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:22.364021 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:22.363767    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs podName:cf6bc5ea-e0e1-415d-b47a-19bc897a699c nodeName:}" failed. No retries permitted until 2026-07-14 02:01:23.363755107 +0000 UTC m=+4.046325932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs") pod "network-metrics-daemon-wnrxm" (UID: "cf6bc5ea-e0e1-415d-b47a-19bc897a699c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 02:01:22.817275 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.817225    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 01:56:21 +0000 UTC" deadline="2027-12-29 13:00:06.041151278 +0000 UTC"
Jul 14 02:01:22.817275 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.817266    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12802h58m43.223890241s"
Jul 14 02:01:22.850005 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:22.849636    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:22.850005 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:22.849777    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:22.955658 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:22.955609    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14d7265f_5e88_4719_ace1_06813f73041e.slice/crio-8ef8cbffdd57358495a23d47a73410679c17ec12a295def5b4e7108bf7b7c5c0 WatchSource:0}: Error finding container 8ef8cbffdd57358495a23d47a73410679c17ec12a295def5b4e7108bf7b7c5c0: Status 404 returned error can't find the container with id 8ef8cbffdd57358495a23d47a73410679c17ec12a295def5b4e7108bf7b7c5c0
Jul 14 02:01:22.962540 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:22.962511    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca207ce_6644_4908_b414_240bccf75bd0.slice/crio-3a47558c328d568f9e1e854667e6c14a56ec92e4b0ae65def12b7c8b01dbd29c WatchSource:0}: Error finding container 3a47558c328d568f9e1e854667e6c14a56ec92e4b0ae65def12b7c8b01dbd29c: Status 404 returned error can't find the container with id 3a47558c328d568f9e1e854667e6c14a56ec92e4b0ae65def12b7c8b01dbd29c
Jul 14 02:01:22.965671 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:22.965647    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53a3ae2_0828_49a1_b4dd_e352caae8834.slice/crio-72ac06eb07cf2244599cbba173bf6797483545f7a3b64cb77858dbb124e41003 WatchSource:0}: Error finding container 72ac06eb07cf2244599cbba173bf6797483545f7a3b64cb77858dbb124e41003: Status 404 returned error can't find the container with id 72ac06eb07cf2244599cbba173bf6797483545f7a3b64cb77858dbb124e41003
Jul 14 02:01:22.966181 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:22.966139    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a91a1c_3798_4615_86e2_e4213dac2b59.slice/crio-43e8b51fa2c02ab1e9194f10856a77f1d95c25e7625aeb6e150bc4d70d6713df WatchSource:0}: Error finding container 43e8b51fa2c02ab1e9194f10856a77f1d95c25e7625aeb6e150bc4d70d6713df: Status 404 returned error can't find the container with id 43e8b51fa2c02ab1e9194f10856a77f1d95c25e7625aeb6e150bc4d70d6713df
Jul 14 02:01:22.967288 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:22.967262    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e87de01_8c13_4fbb_aa19_c08817fda86b.slice/crio-f4b047e5241569c5b346b2c5e8fff0342d51d4691e458ec06e62a9c2676d8bd6 WatchSource:0}: Error finding container f4b047e5241569c5b346b2c5e8fff0342d51d4691e458ec06e62a9c2676d8bd6: Status 404 returned error can't find the container with id f4b047e5241569c5b346b2c5e8fff0342d51d4691e458ec06e62a9c2676d8bd6
Jul 14 02:01:22.988584 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:22.988552    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce00aadc_7129_4a4b_be2d_857793cd0566.slice/crio-f90cb7eeec4660c001ed7b3292761ee461b16aaf2ff29bda7ba9d5216f1ba525 WatchSource:0}: Error finding container f90cb7eeec4660c001ed7b3292761ee461b16aaf2ff29bda7ba9d5216f1ba525: Status 404 returned error can't find the container with id f90cb7eeec4660c001ed7b3292761ee461b16aaf2ff29bda7ba9d5216f1ba525
Jul 14 02:01:22.989987 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:22.989958    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1aa6070_2304_452d_957f_1fe1833526af.slice/crio-941a25873c17df15479f3decfc150438a8a3b500fe3ef8311ab1b5dc44149337 WatchSource:0}: Error finding container 941a25873c17df15479f3decfc150438a8a3b500fe3ef8311ab1b5dc44149337: Status 404 returned error can't find the container with id 941a25873c17df15479f3decfc150438a8a3b500fe3ef8311ab1b5dc44149337
Jul 14 02:01:22.990702 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:22.990675    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08411450_7e59_47d7_86fd_a9df899dc964.slice/crio-c2c736d32faed8d31ab50a112d4c1e3ab6cb1e97fa664cd840e7c03a856671e5 WatchSource:0}: Error finding container c2c736d32faed8d31ab50a112d4c1e3ab6cb1e97fa664cd840e7c03a856671e5: Status 404 returned error can't find the container with id c2c736d32faed8d31ab50a112d4c1e3ab6cb1e97fa664cd840e7c03a856671e5
Jul 14 02:01:22.991779 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:22.991756    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb745a62_430b_4b46_906f_761da9b8cdbe.slice/crio-3732e9c00764dee32390640017660e64f99be0594b58ece3838a7796f89abe5d WatchSource:0}: Error finding container 3732e9c00764dee32390640017660e64f99be0594b58ece3838a7796f89abe5d: Status 404 returned error can't find the container with id 3732e9c00764dee32390640017660e64f99be0594b58ece3838a7796f89abe5d
Jul 14 02:01:23.370410 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.369634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k429n\" (UniqueName: \"kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n\") pod \"network-check-target-kwm2d\" (UID: \"73be1377-1b11-4b2f-b6bf-f27e04d7f3df\") " pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:23.370410 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.369921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs\") pod \"network-metrics-daemon-wnrxm\" (UID: \"cf6bc5ea-e0e1-415d-b47a-19bc897a699c\") " pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:23.370410 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.370031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:23.370410 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:23.369925    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 02:01:23.370410 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:23.370072    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 02:01:23.370410 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:23.370090    2563 projected.go:196] Error preparing data for projected volume kube-api-access-k429n for pod openshift-network-diagnostics/network-check-target-kwm2d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 02:01:23.370410 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:23.370154    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n podName:73be1377-1b11-4b2f-b6bf-f27e04d7f3df nodeName:}" failed. No retries permitted until 2026-07-14 02:01:25.370138481 +0000 UTC m=+6.052709297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k429n" (UniqueName: "kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n") pod "network-check-target-kwm2d" (UID: "73be1377-1b11-4b2f-b6bf-f27e04d7f3df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 02:01:23.370410 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:23.370196    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 02:01:23.370410 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:23.370253    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret podName:68066f26-c4d5-4b49-8e00-88afb1882a06 nodeName:}" failed. No retries permitted until 2026-07-14 02:01:25.370236103 +0000 UTC m=+6.052806942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret") pod "global-pull-secret-syncer-58548" (UID: "68066f26-c4d5-4b49-8e00-88afb1882a06") : object "kube-system"/"original-pull-secret" not registered
Jul 14 02:01:23.370410 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:23.369974    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 02:01:23.370410 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:23.370294    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs podName:cf6bc5ea-e0e1-415d-b47a-19bc897a699c nodeName:}" failed. No retries permitted until 2026-07-14 02:01:25.370283691 +0000 UTC m=+6.052854520 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs") pod "network-metrics-daemon-wnrxm" (UID: "cf6bc5ea-e0e1-415d-b47a-19bc897a699c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 02:01:23.818908 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.818817    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 01:56:21 +0000 UTC" deadline="2027-12-14 04:25:49.858945379 +0000 UTC"
Jul 14 02:01:23.818908 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.818863    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12434h24m26.040087555s"
Jul 14 02:01:23.848819 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.848768    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:23.848989 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:23.848921    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:23.849074 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.848997    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:23.849190 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:23.849124    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:23.881161 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.880999    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d2vht" event={"ID":"08a91a1c-3798-4615-86e2-e4213dac2b59","Type":"ContainerStarted","Data":"43e8b51fa2c02ab1e9194f10856a77f1d95c25e7625aeb6e150bc4d70d6713df"}
Jul 14 02:01:23.888981 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.888932    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffrf7" event={"ID":"2ca207ce-6644-4908-b414-240bccf75bd0","Type":"ContainerStarted","Data":"3a47558c328d568f9e1e854667e6c14a56ec92e4b0ae65def12b7c8b01dbd29c"}
Jul 14 02:01:23.903049 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.903009    2563 generic.go:356] "Generic (PLEG): container finished" podID="6f97932cbaba467da7a20029d884172d" containerID="a4d9ea1291a8309e8aa0475dab80c438942367542304d92d052c1c0f42497024" exitCode=0
Jul 14 02:01:23.903233 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.903125    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal" event={"ID":"6f97932cbaba467da7a20029d884172d","Type":"ContainerDied","Data":"a4d9ea1291a8309e8aa0475dab80c438942367542304d92d052c1c0f42497024"}
Jul 14 02:01:23.917321 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.917285    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-135.ec2.internal" event={"ID":"642dbee9eb2272032636e1b0ef1491d1","Type":"ContainerStarted","Data":"5b341265e43e14d05cbc42557957a7470fd734c50bf5d2b2c18c2c6198c2a2e3"}
Jul 14 02:01:23.927181 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.927138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tqxqv" event={"ID":"08411450-7e59-47d7-86fd-a9df899dc964","Type":"ContainerStarted","Data":"c2c736d32faed8d31ab50a112d4c1e3ab6cb1e97fa664cd840e7c03a856671e5"}
Jul 14 02:01:23.937813 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.937775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q56rq" event={"ID":"a1aa6070-2304-452d-957f-1fe1833526af","Type":"ContainerStarted","Data":"941a25873c17df15479f3decfc150438a8a3b500fe3ef8311ab1b5dc44149337"}
Jul 14 02:01:23.952330 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.952241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lrr5s" event={"ID":"ce00aadc-7129-4a4b-be2d-857793cd0566","Type":"ContainerStarted","Data":"f90cb7eeec4660c001ed7b3292761ee461b16aaf2ff29bda7ba9d5216f1ba525"}
Jul 14 02:01:23.962206 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.962136    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm" event={"ID":"14d7265f-5e88-4719-ace1-06813f73041e","Type":"ContainerStarted","Data":"8ef8cbffdd57358495a23d47a73410679c17ec12a295def5b4e7108bf7b7c5c0"}
Jul 14 02:01:23.975661 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.975619    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7ftxk" event={"ID":"db745a62-430b-4b46-906f-761da9b8cdbe","Type":"ContainerStarted","Data":"3732e9c00764dee32390640017660e64f99be0594b58ece3838a7796f89abe5d"}
Jul 14 02:01:23.978042 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.978006    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r9qbr" event={"ID":"1e87de01-8c13-4fbb-aa19-c08817fda86b","Type":"ContainerStarted","Data":"f4b047e5241569c5b346b2c5e8fff0342d51d4691e458ec06e62a9c2676d8bd6"}
Jul 14 02:01:23.985930 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:23.985891    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb" event={"ID":"a53a3ae2-0828-49a1-b4dd-e352caae8834","Type":"ContainerStarted","Data":"72ac06eb07cf2244599cbba173bf6797483545f7a3b64cb77858dbb124e41003"}
Jul 14 02:01:24.849140 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:24.849046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:24.849660 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:24.849211    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:25.005607 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:25.005497    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal" event={"ID":"6f97932cbaba467da7a20029d884172d","Type":"ContainerStarted","Data":"59841b96fee715950467495782a60a5436c0277d43beb95946bc9abab2e0f20f"}
Jul 14 02:01:25.020954 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:25.020889    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-135.ec2.internal" podStartSLOduration=4.020866175 podStartE2EDuration="4.020866175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 02:01:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:01:23.934180368 +0000 UTC m=+4.616751216" watchObservedRunningTime="2026-07-14 02:01:25.020866175 +0000 UTC m=+5.703437013"
Jul 14 02:01:25.386817 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:25.386777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k429n\" (UniqueName: \"kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n\") pod \"network-check-target-kwm2d\" (UID: \"73be1377-1b11-4b2f-b6bf-f27e04d7f3df\") " pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:25.387014 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:25.386831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs\") pod \"network-metrics-daemon-wnrxm\" (UID: \"cf6bc5ea-e0e1-415d-b47a-19bc897a699c\") " pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:25.387014 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:25.386878    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:25.387146 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:25.387026    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 02:01:25.387146 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:25.387094    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret podName:68066f26-c4d5-4b49-8e00-88afb1882a06 nodeName:}" failed. No retries permitted until 2026-07-14 02:01:29.387074462 +0000 UTC m=+10.069645282 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret") pod "global-pull-secret-syncer-58548" (UID: "68066f26-c4d5-4b49-8e00-88afb1882a06") : object "kube-system"/"original-pull-secret" not registered
Jul 14 02:01:25.387561 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:25.387541    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 02:01:25.387664 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:25.387569    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 02:01:25.387664 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:25.387583    2563 projected.go:196] Error preparing data for projected volume kube-api-access-k429n for pod openshift-network-diagnostics/network-check-target-kwm2d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 02:01:25.387664 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:25.387635    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n podName:73be1377-1b11-4b2f-b6bf-f27e04d7f3df nodeName:}" failed. No retries permitted until 2026-07-14 02:01:29.387618294 +0000 UTC m=+10.070189129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k429n" (UniqueName: "kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n") pod "network-check-target-kwm2d" (UID: "73be1377-1b11-4b2f-b6bf-f27e04d7f3df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 02:01:25.387825 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:25.387696    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 02:01:25.387825 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:25.387728    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs podName:cf6bc5ea-e0e1-415d-b47a-19bc897a699c nodeName:}" failed. No retries permitted until 2026-07-14 02:01:29.387717533 +0000 UTC m=+10.070288363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs") pod "network-metrics-daemon-wnrxm" (UID: "cf6bc5ea-e0e1-415d-b47a-19bc897a699c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 02:01:25.849416 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:25.849328    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:25.849858 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:25.849562    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:25.849858 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:25.849654    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:25.849858 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:25.849737    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:26.849361 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:26.849316    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:26.849544 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:26.849458    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:27.853773 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:27.853161    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:27.853773 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:27.853314    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:27.853773 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:27.853183    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:27.853773 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:27.853421    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:28.849673 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:28.849637    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:28.849872 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:28.849769    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:29.419584 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:29.419538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:29.420042 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:29.419620    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k429n\" (UniqueName: \"kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n\") pod \"network-check-target-kwm2d\" (UID: \"73be1377-1b11-4b2f-b6bf-f27e04d7f3df\") " pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:29.420042 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:29.419648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs\") pod \"network-metrics-daemon-wnrxm\" (UID: \"cf6bc5ea-e0e1-415d-b47a-19bc897a699c\") " pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:29.420042 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:29.419705    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 02:01:29.420042 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:29.419757    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 02:01:29.420042 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:29.419787    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret podName:68066f26-c4d5-4b49-8e00-88afb1882a06 nodeName:}" failed. No retries permitted until 2026-07-14 02:01:37.419764872 +0000 UTC m=+18.102335710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret") pod "global-pull-secret-syncer-58548" (UID: "68066f26-c4d5-4b49-8e00-88afb1882a06") : object "kube-system"/"original-pull-secret" not registered
Jul 14 02:01:29.420042 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:29.419810    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs podName:cf6bc5ea-e0e1-415d-b47a-19bc897a699c nodeName:}" failed. No retries permitted until 2026-07-14 02:01:37.419798594 +0000 UTC m=+18.102369417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs") pod "network-metrics-daemon-wnrxm" (UID: "cf6bc5ea-e0e1-415d-b47a-19bc897a699c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 02:01:29.420042 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:29.419866    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 02:01:29.420042 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:29.419881    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 02:01:29.420042 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:29.419893    2563 projected.go:196] Error preparing data for projected volume kube-api-access-k429n for pod openshift-network-diagnostics/network-check-target-kwm2d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 02:01:29.420042 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:29.419931    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n podName:73be1377-1b11-4b2f-b6bf-f27e04d7f3df nodeName:}" failed. No retries permitted until 2026-07-14 02:01:37.419915373 +0000 UTC m=+18.102486189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k429n" (UniqueName: "kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n") pod "network-check-target-kwm2d" (UID: "73be1377-1b11-4b2f-b6bf-f27e04d7f3df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 02:01:29.850562 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:29.850477    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:29.850713 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:29.850598    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:29.850713 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:29.850678    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:29.850850 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:29.850826    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:30.849026 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:30.848989    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:30.849523 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:30.849131    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:31.849802 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:31.849763    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:31.850285 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:31.849911    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:31.850285 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:31.850118    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:31.850285 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:31.850225    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:32.849365 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:32.849326    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:32.849587 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:32.849462    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:33.848961 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:33.848927    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:33.849373 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:33.849074    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:33.849373 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:33.849107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:33.849373 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:33.849221    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:34.849561 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:34.849522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:34.850067 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:34.849677    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:35.849350 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:35.849312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:35.849543 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:35.849312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:35.849543 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:35.849471    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:35.849949 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:35.849557    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:36.849812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:36.849772    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:36.850263 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:36.849914    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:37.481082 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:37.481029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:37.481262 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:37.481123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k429n\" (UniqueName: \"kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n\") pod \"network-check-target-kwm2d\" (UID: \"73be1377-1b11-4b2f-b6bf-f27e04d7f3df\") " pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:37.481262 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:37.481151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs\") pod \"network-metrics-daemon-wnrxm\" (UID: \"cf6bc5ea-e0e1-415d-b47a-19bc897a699c\") " pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:37.481262 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:37.481182    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 02:01:37.481262 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:37.481258    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 02:01:37.481452 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:37.481269    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret podName:68066f26-c4d5-4b49-8e00-88afb1882a06 nodeName:}" failed. No retries permitted until 2026-07-14 02:01:53.481232302 +0000 UTC m=+34.163803133 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret") pod "global-pull-secret-syncer-58548" (UID: "68066f26-c4d5-4b49-8e00-88afb1882a06") : object "kube-system"/"original-pull-secret" not registered
Jul 14 02:01:37.481452 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:37.481293    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs podName:cf6bc5ea-e0e1-415d-b47a-19bc897a699c nodeName:}" failed. No retries permitted until 2026-07-14 02:01:53.481282326 +0000 UTC m=+34.163853140 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs") pod "network-metrics-daemon-wnrxm" (UID: "cf6bc5ea-e0e1-415d-b47a-19bc897a699c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 02:01:37.481452 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:37.481290    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 02:01:37.481452 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:37.481317    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 02:01:37.481452 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:37.481330    2563 projected.go:196] Error preparing data for projected volume kube-api-access-k429n for pod openshift-network-diagnostics/network-check-target-kwm2d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 02:01:37.481452 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:37.481390    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n podName:73be1377-1b11-4b2f-b6bf-f27e04d7f3df nodeName:}" failed. No retries permitted until 2026-07-14 02:01:53.481371688 +0000 UTC m=+34.163942507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k429n" (UniqueName: "kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n") pod "network-check-target-kwm2d" (UID: "73be1377-1b11-4b2f-b6bf-f27e04d7f3df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 02:01:37.849798 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:37.849708    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:37.849798 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:37.849734    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:37.850276 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:37.849828    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:37.850276 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:37.849963    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:38.849555 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:38.849516    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:38.849740 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:38.849632    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:39.849526 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:39.849466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:39.849978 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:39.849586    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:39.849978 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:39.849659    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:39.849978 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:39.849755    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:40.849559 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:40.849520    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:40.850025 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:40.849638    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:41.851304 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:41.850524    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:41.851304 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:41.850665    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:41.851304 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:41.851104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:41.851304 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:41.851232    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:42.041347 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:42.041012    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tqxqv" event={"ID":"08411450-7e59-47d7-86fd-a9df899dc964","Type":"ContainerStarted","Data":"8d8cc0e5f310be480e97c982adedfe84d57136d6658216181f9b300e6d49f482"}
Jul 14 02:01:42.043515 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:42.043481    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q56rq" event={"ID":"a1aa6070-2304-452d-957f-1fe1833526af","Type":"ContainerStarted","Data":"5f75d85b5963c93e999b06c8276a20fe7e9d94dc32ad98dc0d547c5019a53589"}
Jul 14 02:01:42.045146 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:42.045053    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm" event={"ID":"14d7265f-5e88-4719-ace1-06813f73041e","Type":"ContainerStarted","Data":"0630ebac38d722777ea295a7e37c17e614302ce0502524b03a4b0c5e791fc8a3"}
Jul 14 02:01:42.046658 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:42.046636    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7ftxk" event={"ID":"db745a62-430b-4b46-906f-761da9b8cdbe","Type":"ContainerStarted","Data":"465597e1329f2c7c3c19a8b0583e07d3299b00e773c8706356d7d07268b0a08d"}
Jul 14 02:01:42.049888 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:42.049860    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r9qbr" event={"ID":"1e87de01-8c13-4fbb-aa19-c08817fda86b","Type":"ContainerStarted","Data":"99150b6ba96f024d88c7332fa29e0ddde22fca9d60f33f399482541069b372be"}
Jul 14 02:01:42.051424 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:42.051399    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb" event={"ID":"a53a3ae2-0828-49a1-b4dd-e352caae8834","Type":"ContainerStarted","Data":"8c9dd36b51596dea2d3052177eda8bf9cb498c70b3ba32c5895480909053b6a8"}
Jul 14 02:01:42.052693 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:42.052653    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d2vht" event={"ID":"08a91a1c-3798-4615-86e2-e4213dac2b59","Type":"ContainerStarted","Data":"e40782bb0df9115fd2daaef80ee65e5a19390f9912a0d4640e5402b9f1197996"}
Jul 14 02:01:42.053748 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:42.053729    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffrf7" event={"ID":"2ca207ce-6644-4908-b414-240bccf75bd0","Type":"ContainerStarted","Data":"2cf7396bad3d93a4e007a1ffdeddb677b1e031ccf79f5f314840b5b81e5b47fd"}
Jul 14 02:01:42.061213 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:42.059642    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tqxqv" podStartSLOduration=3.233228382 podStartE2EDuration="22.05962132s" totalImagesPullingTime="18.826392938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 02:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:01:42.057886744 +0000 UTC m=+22.740457601" watchObservedRunningTime="2026-07-14 02:01:42.05962132 +0000 UTC m=+22.742192163"
Jul 14 02:01:42.061213 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:42.059765    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-135.ec2.internal" podStartSLOduration=21.059757948 podStartE2EDuration="21.059757948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 02:01:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:01:25.021562311 +0000 UTC m=+5.704133148" watchObservedRunningTime="2026-07-14 02:01:42.059757948 +0000 UTC m=+22.742328786"
Jul 14 02:01:42.075573 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:42.075525    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7ftxk" podStartSLOduration=3.247621688 podStartE2EDuration="22.075508775s" totalImagesPullingTime="18.827887087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 02:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:01:42.075176841 +0000 UTC m=+22.757747691" watchObservedRunningTime="2026-07-14 02:01:42.075508775 +0000 UTC m=+22.758079611"
Jul 14 02:01:42.092499 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:42.092449    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r9qbr" podStartSLOduration=4.244884407 podStartE2EDuration="23.092436045s" totalImagesPullingTime="18.847551638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 02:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:01:42.092371904 +0000 UTC m=+22.774942742" watchObservedRunningTime="2026-07-14 02:01:42.092436045 +0000 UTC m=+22.775006872"
Jul 14 02:01:42.154656 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:42.154602    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d2vht" podStartSLOduration=3.266509825 podStartE2EDuration="22.15458007s" totalImagesPullingTime="18.888070245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 02:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:01:42.154409849 +0000 UTC m=+22.836980687" watchObservedRunningTime="2026-07-14 02:01:42.15458007 +0000 UTC m=+22.837150909"
Jul 14 02:01:42.205089 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:42.205014    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q56rq" podStartSLOduration=3.378710474 podStartE2EDuration="22.204990926s" totalImagesPullingTime="18.826280452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:01:42.204926499 +0000 UTC m=+22.887497347" watchObservedRunningTime="2026-07-14 02:01:42.204990926 +0000 UTC m=+22.887561764"
Jul 14 02:01:42.849678 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:42.849500    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:42.849795 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:42.849757    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:43.059779 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.059740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lrr5s" event={"ID":"ce00aadc-7129-4a4b-be2d-857793cd0566","Type":"ContainerStarted","Data":"17912a0652d436edc7fbfd93143383d5e991147a19ccc265d415209746fe86e0"}
Jul 14 02:01:43.062426 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.062402    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:01:43.062799 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.062768    2563 generic.go:356] "Generic (PLEG): container finished" podID="a53a3ae2-0828-49a1-b4dd-e352caae8834" containerID="49743bb3150b5a52bb224d6be36eff97c79147f323bb8b6a848f79feabf5c17f" exitCode=1
Jul 14 02:01:43.062913 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.062837    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb" event={"ID":"a53a3ae2-0828-49a1-b4dd-e352caae8834","Type":"ContainerStarted","Data":"93b1f54d9b9cf53a426b3d64cac4bf41eb09079bbdf79bae1dd20aa78956c58c"}
Jul 14 02:01:43.062913 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.062909    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb" event={"ID":"a53a3ae2-0828-49a1-b4dd-e352caae8834","Type":"ContainerStarted","Data":"41b3ff9221fcb4dbf7be33c27c55d478661f775ed8dd35a5f54a482d15563d02"}
Jul 14 02:01:43.063034 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.062944    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb" event={"ID":"a53a3ae2-0828-49a1-b4dd-e352caae8834","Type":"ContainerStarted","Data":"cc45814bda615eb272a50c64861bd949dedf286e7804d1eaac521657beb1722f"}
Jul 14 02:01:43.063034 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.062980    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb" event={"ID":"a53a3ae2-0828-49a1-b4dd-e352caae8834","Type":"ContainerStarted","Data":"99a6500e7a0342dd8f971ba2df8b8fc620272106c9dbd448f4dfe0c80bf31245"}
Jul 14 02:01:43.063034 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.063008    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb" event={"ID":"a53a3ae2-0828-49a1-b4dd-e352caae8834","Type":"ContainerDied","Data":"49743bb3150b5a52bb224d6be36eff97c79147f323bb8b6a848f79feabf5c17f"}
Jul 14 02:01:43.064215 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.064195    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ca207ce-6644-4908-b414-240bccf75bd0" containerID="2cf7396bad3d93a4e007a1ffdeddb677b1e031ccf79f5f314840b5b81e5b47fd" exitCode=0
Jul 14 02:01:43.064321 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.064300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffrf7" event={"ID":"2ca207ce-6644-4908-b414-240bccf75bd0","Type":"ContainerDied","Data":"2cf7396bad3d93a4e007a1ffdeddb677b1e031ccf79f5f314840b5b81e5b47fd"}
Jul 14 02:01:43.074847 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.074800    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lrr5s" podStartSLOduration=5.246008377 podStartE2EDuration="24.074783485s" totalImagesPullingTime="18.828775108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 02:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:01:43.074076495 +0000 UTC m=+23.756647333" watchObservedRunningTime="2026-07-14 02:01:43.074783485 +0000 UTC m=+23.757354322"
Jul 14 02:01:43.189924 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.189895    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 02:01:43.822352 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.822236    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T02:01:43.189918424Z","UUID":"c781de6f-5f52-4dc6-ae0e-cec7e840e529","Handler":null,"Name":"","Endpoint":""}
Jul 14 02:01:43.824293 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.824270    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 02:01:43.824293 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.824318    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 02:01:43.849371 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.849289    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:43.849371 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:43.849328    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:43.849729 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:43.849424    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:43.849729 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:43.849602    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:44.069593 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:44.069557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm" event={"ID":"14d7265f-5e88-4719-ace1-06813f73041e","Type":"ContainerStarted","Data":"1bbd008fa4155202a8e8b305f4c2cfe6e77ef577c2eaa546690c498bd61ee6f2"}
Jul 14 02:01:44.849632 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:44.849603    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:44.849828 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:44.849720    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:45.075181 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:45.075124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm" event={"ID":"14d7265f-5e88-4719-ace1-06813f73041e","Type":"ContainerStarted","Data":"216d22cac685633eed3ba170e5a6e0daddb93b7df98c9c80fd30f5b63536c464"}
Jul 14 02:01:45.079080 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:45.079052    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:01:45.079542 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:45.079506    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb" event={"ID":"a53a3ae2-0828-49a1-b4dd-e352caae8834","Type":"ContainerStarted","Data":"4af8c068f1610b7ebb792918875e15c5de240dd0d62272c1734e915bed80fdf3"}
Jul 14 02:01:45.095760 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:45.095705    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mttnm" podStartSLOduration=4.171059983 podStartE2EDuration="25.095683037s" totalImagesPullingTime="20.924623054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 02:01:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:01:45.094983246 +0000 UTC m=+25.777554103" watchObservedRunningTime="2026-07-14 02:01:45.095683037 +0000 UTC m=+25.778253875"
Jul 14 02:01:45.849118 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:45.848889    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:45.849338 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:45.848952    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:45.849338 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:45.849253    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:45.849338 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:45.849304    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:45.997939 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:45.997902    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q56rq"
Jul 14 02:01:45.998524 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:45.998502    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q56rq"
Jul 14 02:01:46.082337 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:46.082305    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q56rq"
Jul 14 02:01:46.082837 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:46.082681    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q56rq"
Jul 14 02:01:46.849350 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:46.849312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:46.849525 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:46.849455    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:47.849569 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:47.849542    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:47.850314 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:47.849645    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:47.850314 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:47.849748    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:47.850314 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:47.849873    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:48.089725 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:48.089692    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:01:48.090154 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:48.090125    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb" event={"ID":"a53a3ae2-0828-49a1-b4dd-e352caae8834","Type":"ContainerStarted","Data":"6c12748a7a6c4db2ebad95a9d6d9f2c362a57a288f80885cb9c05331b79c4d04"}
Jul 14 02:01:48.090428 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:48.090401    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:48.090542 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:48.090484    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:48.090660 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:48.090645    2563 scope.go:117] "RemoveContainer" containerID="49743bb3150b5a52bb224d6be36eff97c79147f323bb8b6a848f79feabf5c17f"
Jul 14 02:01:48.092047 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:48.092020    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ca207ce-6644-4908-b414-240bccf75bd0" containerID="bfd8a6036e431f3355a1875c5d721381eb5fafbe7471288be31db4ae1b4713a6" exitCode=0
Jul 14 02:01:48.092152 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:48.092087    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffrf7" event={"ID":"2ca207ce-6644-4908-b414-240bccf75bd0","Type":"ContainerDied","Data":"bfd8a6036e431f3355a1875c5d721381eb5fafbe7471288be31db4ae1b4713a6"}
Jul 14 02:01:48.106733 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:48.106701    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:48.849154 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:48.849123    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:48.849382 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:48.849247    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:49.101572 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:49.101503    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:01:49.102053 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:49.101969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb" event={"ID":"a53a3ae2-0828-49a1-b4dd-e352caae8834","Type":"ContainerStarted","Data":"e474d1a7a955779d4421ffd25eba0f1749b34a14a778093bbb92f55c2b74b632"}
Jul 14 02:01:49.102206 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:49.102190    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:49.117421 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:49.117385    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:01:49.130373 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:49.130323    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb" podStartSLOduration=10.229176191 podStartE2EDuration="29.130308401s" totalImagesPullingTime="18.90113221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 02:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:01:49.129958201 +0000 UTC m=+29.812529038" watchObservedRunningTime="2026-07-14 02:01:49.130308401 +0000 UTC m=+29.812879285"
Jul 14 02:01:49.446347 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:49.446301    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kwm2d"]
Jul 14 02:01:49.446685 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:49.446654    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:49.446823 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:49.446754    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:49.447084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:49.447062    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wnrxm"]
Jul 14 02:01:49.447214 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:49.447200    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:49.447335 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:49.447316    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:49.459543 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:49.459520    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-58548"]
Jul 14 02:01:49.459670 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:49.459642    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:49.459793 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:49.459739    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:50.105986 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:50.105943    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ca207ce-6644-4908-b414-240bccf75bd0" containerID="63068aa6e8e89871f64c4d44b0ef153aacf203645343bb8ec99cb4a8d50e3551" exitCode=0
Jul 14 02:01:50.106448 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:50.106023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffrf7" event={"ID":"2ca207ce-6644-4908-b414-240bccf75bd0","Type":"ContainerDied","Data":"63068aa6e8e89871f64c4d44b0ef153aacf203645343bb8ec99cb4a8d50e3551"}
Jul 14 02:01:50.848888 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:50.848845    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:50.848888 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:50.848896    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:50.849135 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:50.848979    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:50.849135 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:50.849033    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:51.849013 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:51.848828    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:51.849453 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:51.849103    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:52.113546 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:52.113452    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ca207ce-6644-4908-b414-240bccf75bd0" containerID="9475ca70097872fd4b0013c71149706b3f47518ee381c01420a6ef81572f9211" exitCode=0
Jul 14 02:01:52.113546 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:52.113506    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffrf7" event={"ID":"2ca207ce-6644-4908-b414-240bccf75bd0","Type":"ContainerDied","Data":"9475ca70097872fd4b0013c71149706b3f47518ee381c01420a6ef81572f9211"}
Jul 14 02:01:52.849256 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:52.849220    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:52.849848 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:52.849221    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:52.849848 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:52.849344    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwm2d" podUID="73be1377-1b11-4b2f-b6bf-f27e04d7f3df"
Jul 14 02:01:52.849848 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:52.849447    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58548" podUID="68066f26-c4d5-4b49-8e00-88afb1882a06"
Jul 14 02:01:53.508131 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:53.508091    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k429n\" (UniqueName: \"kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n\") pod \"network-check-target-kwm2d\" (UID: \"73be1377-1b11-4b2f-b6bf-f27e04d7f3df\") " pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:53.508131 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:53.508142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs\") pod \"network-metrics-daemon-wnrxm\" (UID: \"cf6bc5ea-e0e1-415d-b47a-19bc897a699c\") " pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:53.508407 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:53.508257    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:53.508407 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:53.508293    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 02:01:53.508407 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:53.508364    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs podName:cf6bc5ea-e0e1-415d-b47a-19bc897a699c nodeName:}" failed. No retries permitted until 2026-07-14 02:02:25.508342312 +0000 UTC m=+66.190913131 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs") pod "network-metrics-daemon-wnrxm" (UID: "cf6bc5ea-e0e1-415d-b47a-19bc897a699c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 02:01:53.508556 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:53.508425    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 02:01:53.508556 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:53.508451    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 02:01:53.508556 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:53.508466    2563 projected.go:196] Error preparing data for projected volume kube-api-access-k429n for pod openshift-network-diagnostics/network-check-target-kwm2d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 02:01:53.508556 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:53.508518    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n podName:73be1377-1b11-4b2f-b6bf-f27e04d7f3df nodeName:}" failed. No retries permitted until 2026-07-14 02:02:25.508500265 +0000 UTC m=+66.191071093 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k429n" (UniqueName: "kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n") pod "network-check-target-kwm2d" (UID: "73be1377-1b11-4b2f-b6bf-f27e04d7f3df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 02:01:53.508556 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:53.508427    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 02:01:53.508708 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:53.508591    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret podName:68066f26-c4d5-4b49-8e00-88afb1882a06 nodeName:}" failed. No retries permitted until 2026-07-14 02:02:25.508571149 +0000 UTC m=+66.191141975 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret") pod "global-pull-secret-syncer-58548" (UID: "68066f26-c4d5-4b49-8e00-88afb1882a06") : object "kube-system"/"original-pull-secret" not registered
Jul 14 02:01:53.849439 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:53.849410    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:53.849857 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:53.849525    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnrxm" podUID="cf6bc5ea-e0e1-415d-b47a-19bc897a699c"
Jul 14 02:01:54.556315 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.556282    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-135.ec2.internal" event="NodeReady"
Jul 14 02:01:54.556476 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.556449    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 02:01:54.590643 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.590609    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57fb4955f-5m882"]
Jul 14 02:01:54.592724 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.592696    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.595547 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.595129    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 14 02:01:54.595547 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.595272    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 14 02:01:54.595547 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.595305    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 14 02:01:54.595547 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.595392    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fmxrd\""
Jul 14 02:01:54.600112 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.600083    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sdm9d"]
Jul 14 02:01:54.600873 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.600844    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 14 02:01:54.602536 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.602518    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sdm9d"
Jul 14 02:01:54.603180 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.603148    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qm78c"]
Jul 14 02:01:54.604865 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.604847    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qm78c"
Jul 14 02:01:54.605124 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.605062    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 02:01:54.605583 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.604943    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 02:01:54.605647 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.605632    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jlvpc\""
Jul 14 02:01:54.606098 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.605921    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 02:01:54.606617 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.606593    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57fb4955f-5m882"]
Jul 14 02:01:54.607347 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.607319    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qrrwt\""
Jul 14 02:01:54.607563 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.607543    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 02:01:54.607656 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.607637    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 02:01:54.612442 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.612216    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sdm9d"]
Jul 14 02:01:54.615735 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.615712    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qm78c"]
Jul 14 02:01:54.717354 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.717262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd6np\" (UniqueName: \"kubernetes.io/projected/08730f0e-7030-486d-9d4b-62e2e12e9080-kube-api-access-cd6np\") pod \"ingress-canary-sdm9d\" (UID: \"08730f0e-7030-486d-9d4b-62e2e12e9080\") " pod="openshift-ingress-canary/ingress-canary-sdm9d"
Jul 14 02:01:54.717354 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.717319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eca00a03-22f7-41d7-8633-f328a946aa58-trusted-ca\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.717354 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.717339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-config-volume\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:01:54.717586 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.717360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:01:54.717586 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.717473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08730f0e-7030-486d-9d4b-62e2e12e9080-cert\") pod \"ingress-canary-sdm9d\" (UID: \"08730f0e-7030-486d-9d4b-62e2e12e9080\") " pod="openshift-ingress-canary/ingress-canary-sdm9d"
Jul 14 02:01:54.717586 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.717522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzrbk\" (UniqueName: \"kubernetes.io/projected/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-kube-api-access-dzrbk\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:01:54.717586 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.717553    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.717729 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.717605    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eca00a03-22f7-41d7-8633-f328a946aa58-registry-certificates\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.717729 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.717652    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eca00a03-22f7-41d7-8633-f328a946aa58-ca-trust-extracted\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.717729 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.717672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eca00a03-22f7-41d7-8633-f328a946aa58-installation-pull-secrets\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.717729 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.717699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-tmp-dir\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:01:54.717877 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.717825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-bound-sa-token\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.717877 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.717858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swhbw\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-kube-api-access-swhbw\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.717970 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.717889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eca00a03-22f7-41d7-8633-f328a946aa58-image-registry-private-configuration\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.732847 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.732810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q56rq_a1aa6070-2304-452d-957f-1fe1833526af/konnectivity-agent/0.log" limit=1024
Jul 14 02:01:54.815816 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.815767    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q56rq_a1aa6070-2304-452d-957f-1fe1833526af/konnectivity-agent/0.log" limit=1024
Jul 14 02:01:54.818634 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.818587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eca00a03-22f7-41d7-8633-f328a946aa58-registry-certificates\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.818842 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.818639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eca00a03-22f7-41d7-8633-f328a946aa58-ca-trust-extracted\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.818842 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.818771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eca00a03-22f7-41d7-8633-f328a946aa58-installation-pull-secrets\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.818842 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.818817    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-tmp-dir\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:01:54.819107 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.818883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-bound-sa-token\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.819107 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.818913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swhbw\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-kube-api-access-swhbw\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.819107 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.818945    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eca00a03-22f7-41d7-8633-f328a946aa58-image-registry-private-configuration\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.819107 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.818989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd6np\" (UniqueName: \"kubernetes.io/projected/08730f0e-7030-486d-9d4b-62e2e12e9080-kube-api-access-cd6np\") pod \"ingress-canary-sdm9d\" (UID: \"08730f0e-7030-486d-9d4b-62e2e12e9080\") " pod="openshift-ingress-canary/ingress-canary-sdm9d"
Jul 14 02:01:54.819107 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.819032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eca00a03-22f7-41d7-8633-f328a946aa58-trusted-ca\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.819107 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.819056    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-config-volume\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:01:54.819107 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.819075    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eca00a03-22f7-41d7-8633-f328a946aa58-ca-trust-extracted\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.819554 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.819078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:01:54.819554 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.819191    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08730f0e-7030-486d-9d4b-62e2e12e9080-cert\") pod \"ingress-canary-sdm9d\" (UID: \"08730f0e-7030-486d-9d4b-62e2e12e9080\") " pod="openshift-ingress-canary/ingress-canary-sdm9d"
Jul 14 02:01:54.819554 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.819222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzrbk\" (UniqueName: \"kubernetes.io/projected/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-kube-api-access-dzrbk\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:01:54.819554 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.819255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.819554 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.819303    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eca00a03-22f7-41d7-8633-f328a946aa58-registry-certificates\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.819554 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.819353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-tmp-dir\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:01:54.819554 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:54.819384    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 02:01:54.819554 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:54.819400    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57fb4955f-5m882: secret "image-registry-tls" not found
Jul 14 02:01:54.819554 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:54.819456    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls podName:eca00a03-22f7-41d7-8633-f328a946aa58 nodeName:}" failed. No retries permitted until 2026-07-14 02:01:55.3194363 +0000 UTC m=+36.002007118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls") pod "image-registry-57fb4955f-5m882" (UID: "eca00a03-22f7-41d7-8633-f328a946aa58") : secret "image-registry-tls" not found
Jul 14 02:01:54.820011 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:54.819884    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 02:01:54.820011 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:54.819936    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls podName:c7dd9ccd-d174-4a35-a879-ad714f1d0c18 nodeName:}" failed. No retries permitted until 2026-07-14 02:01:55.319920532 +0000 UTC m=+36.002491359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls") pod "dns-default-qm78c" (UID: "c7dd9ccd-d174-4a35-a879-ad714f1d0c18") : secret "dns-default-metrics-tls" not found
Jul 14 02:01:54.820841 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.820793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-config-volume\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:01:54.820947 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.820883    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eca00a03-22f7-41d7-8633-f328a946aa58-trusted-ca\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.824426 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.824400    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eca00a03-22f7-41d7-8633-f328a946aa58-installation-pull-secrets\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.824426 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.824419    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08730f0e-7030-486d-9d4b-62e2e12e9080-cert\") pod \"ingress-canary-sdm9d\" (UID: \"08730f0e-7030-486d-9d4b-62e2e12e9080\") " pod="openshift-ingress-canary/ingress-canary-sdm9d"
Jul 14 02:01:54.824598 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.824400    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eca00a03-22f7-41d7-8633-f328a946aa58-image-registry-private-configuration\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.830820 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.830790    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzrbk\" (UniqueName: \"kubernetes.io/projected/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-kube-api-access-dzrbk\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:01:54.830820 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.830798    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd6np\" (UniqueName: \"kubernetes.io/projected/08730f0e-7030-486d-9d4b-62e2e12e9080-kube-api-access-cd6np\") pod \"ingress-canary-sdm9d\" (UID: \"08730f0e-7030-486d-9d4b-62e2e12e9080\") " pod="openshift-ingress-canary/ingress-canary-sdm9d"
Jul 14 02:01:54.830990 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.830856    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-bound-sa-token\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.831267 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.831241    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swhbw\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-kube-api-access-swhbw\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:54.849322 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.849290    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:01:54.849489 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.849308    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:01:54.852458 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.852432    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 02:01:54.852458 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.852450    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 02:01:54.852658 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.852432    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 02:01:54.852658 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.852444    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mrlfg\""
Jul 14 02:01:54.917616 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:54.917572    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sdm9d"
Jul 14 02:01:55.054061 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:55.053872    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sdm9d"]
Jul 14 02:01:55.058394 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:01:55.058366    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08730f0e_7030_486d_9d4b_62e2e12e9080.slice/crio-bce50873e52459b685967ce13aad7f3aeced645baa3e602fd821c0e185badab7 WatchSource:0}: Error finding container bce50873e52459b685967ce13aad7f3aeced645baa3e602fd821c0e185badab7: Status 404 returned error can't find the container with id bce50873e52459b685967ce13aad7f3aeced645baa3e602fd821c0e185badab7
Jul 14 02:01:55.123061 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:55.123013    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sdm9d" event={"ID":"08730f0e-7030-486d-9d4b-62e2e12e9080","Type":"ContainerStarted","Data":"bce50873e52459b685967ce13aad7f3aeced645baa3e602fd821c0e185badab7"}
Jul 14 02:01:55.322337 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:55.322294    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:55.322570 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:55.322430    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:01:55.322570 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:55.322471    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 02:01:55.322570 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:55.322494    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57fb4955f-5m882: secret "image-registry-tls" not found
Jul 14 02:01:55.322570 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:55.322548    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 02:01:55.322570 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:55.322560    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls podName:eca00a03-22f7-41d7-8633-f328a946aa58 nodeName:}" failed. No retries permitted until 2026-07-14 02:01:56.32254088 +0000 UTC m=+37.005111708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls") pod "image-registry-57fb4955f-5m882" (UID: "eca00a03-22f7-41d7-8633-f328a946aa58") : secret "image-registry-tls" not found
Jul 14 02:01:55.322821 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:55.322627    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls podName:c7dd9ccd-d174-4a35-a879-ad714f1d0c18 nodeName:}" failed. No retries permitted until 2026-07-14 02:01:56.322607832 +0000 UTC m=+37.005178662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls") pod "dns-default-qm78c" (UID: "c7dd9ccd-d174-4a35-a879-ad714f1d0c18") : secret "dns-default-metrics-tls" not found
Jul 14 02:01:55.849232 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:55.849196    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:01:55.852188 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:55.851977    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 02:01:55.852188 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:55.852131    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-klxhd\""
Jul 14 02:01:56.329676 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:56.329633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:56.329866 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:56.329757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:01:56.329866 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:56.329799    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 02:01:56.329866 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:56.329816    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57fb4955f-5m882: secret "image-registry-tls" not found
Jul 14 02:01:56.329866 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:56.329847    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 02:01:56.330025 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:56.329885    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls podName:eca00a03-22f7-41d7-8633-f328a946aa58 nodeName:}" failed. No retries permitted until 2026-07-14 02:01:58.329864667 +0000 UTC m=+39.012435503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls") pod "image-registry-57fb4955f-5m882" (UID: "eca00a03-22f7-41d7-8633-f328a946aa58") : secret "image-registry-tls" not found
Jul 14 02:01:56.330025 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:56.329906    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls podName:c7dd9ccd-d174-4a35-a879-ad714f1d0c18 nodeName:}" failed. No retries permitted until 2026-07-14 02:01:58.329896018 +0000 UTC m=+39.012466833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls") pod "dns-default-qm78c" (UID: "c7dd9ccd-d174-4a35-a879-ad714f1d0c18") : secret "dns-default-metrics-tls" not found
Jul 14 02:01:57.131721 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:57.131681    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ca207ce-6644-4908-b414-240bccf75bd0" containerID="cf683e6c5c1a4c3fcf4ba57438a14800030d36ec8eb31e491d21e8ab26b09606" exitCode=0
Jul 14 02:01:57.132140 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:57.131752    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffrf7" event={"ID":"2ca207ce-6644-4908-b414-240bccf75bd0","Type":"ContainerDied","Data":"cf683e6c5c1a4c3fcf4ba57438a14800030d36ec8eb31e491d21e8ab26b09606"}
Jul 14 02:01:58.137449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:58.137411    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ca207ce-6644-4908-b414-240bccf75bd0" containerID="bee8379702be76fa20b83c24a8e44d3ced25cf2b2565b0d451a5a37d52769fcf" exitCode=0
Jul 14 02:01:58.137882 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:58.137479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffrf7" event={"ID":"2ca207ce-6644-4908-b414-240bccf75bd0","Type":"ContainerDied","Data":"bee8379702be76fa20b83c24a8e44d3ced25cf2b2565b0d451a5a37d52769fcf"}
Jul 14 02:01:58.345639 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:58.345598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:01:58.345839 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:58.345710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:01:58.345839 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:58.345775    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 02:01:58.345839 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:58.345798    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57fb4955f-5m882: secret "image-registry-tls" not found
Jul 14 02:01:58.345839 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:58.345819    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 02:01:58.346005 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:58.345865    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls podName:eca00a03-22f7-41d7-8633-f328a946aa58 nodeName:}" failed. No retries permitted until 2026-07-14 02:02:02.345842445 +0000 UTC m=+43.028413259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls") pod "image-registry-57fb4955f-5m882" (UID: "eca00a03-22f7-41d7-8633-f328a946aa58") : secret "image-registry-tls" not found
Jul 14 02:01:58.346005 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:01:58.345882    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls podName:c7dd9ccd-d174-4a35-a879-ad714f1d0c18 nodeName:}" failed. No retries permitted until 2026-07-14 02:02:02.345875573 +0000 UTC m=+43.028446389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls") pod "dns-default-qm78c" (UID: "c7dd9ccd-d174-4a35-a879-ad714f1d0c18") : secret "dns-default-metrics-tls" not found
Jul 14 02:01:59.145651 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:59.145300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffrf7" event={"ID":"2ca207ce-6644-4908-b414-240bccf75bd0","Type":"ContainerStarted","Data":"fd21949c986353b7942df0c1fb7f918becb339a9bdf12c8dc1f0e27797d09717"}
Jul 14 02:01:59.174573 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:59.174511    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ffrf7" podStartSLOduration=9.120822579 podStartE2EDuration="39.174488587s" totalImagesPullingTime="30.053666008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 02:01:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:01:59.173853225 +0000 UTC m=+39.856424063" watchObservedRunningTime="2026-07-14 02:01:59.174488587 +0000 UTC m=+39.857059474"
Jul 14 02:01:59.295675 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:59.295640    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q56rq_a1aa6070-2304-452d-957f-1fe1833526af/konnectivity-agent/0.log" limit=1024
Jul 14 02:01:59.395450 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:01:59.395412    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q56rq_a1aa6070-2304-452d-957f-1fe1833526af/konnectivity-agent/0.log" limit=1024
Jul 14 02:02:00.149025 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:00.148986    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sdm9d" event={"ID":"08730f0e-7030-486d-9d4b-62e2e12e9080","Type":"ContainerStarted","Data":"bba4e133715290c476118446f115ae0daced8df629b744a785c8905bcc764b2d"}
Jul 14 02:02:00.166363 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:00.166310    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sdm9d" podStartSLOduration=1.796786246 podStartE2EDuration="6.166293675s" totalImagesPullingTime="4.369507429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:02:00.16509335 +0000 UTC m=+40.847664208" watchObservedRunningTime="2026-07-14 02:02:00.166293675 +0000 UTC m=+40.848864512"
Jul 14 02:02:01.255909 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:01.255862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q56rq_a1aa6070-2304-452d-957f-1fe1833526af/konnectivity-agent/0.log" limit=1024
Jul 14 02:02:01.348400 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:01.348367    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-q56rq_a1aa6070-2304-452d-957f-1fe1833526af/konnectivity-agent/0.log" limit=1024
Jul 14 02:02:02.375751 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:02.375703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:02:02.376140 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:02.375810    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:02:02.376140 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:02.375861    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 02:02:02.376140 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:02.375881    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57fb4955f-5m882: secret "image-registry-tls" not found
Jul 14 02:02:02.376140 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:02.375906    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 02:02:02.376140 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:02.375938    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls podName:eca00a03-22f7-41d7-8633-f328a946aa58 nodeName:}" failed. No retries permitted until 2026-07-14 02:02:10.37592123 +0000 UTC m=+51.058492046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls") pod "image-registry-57fb4955f-5m882" (UID: "eca00a03-22f7-41d7-8633-f328a946aa58") : secret "image-registry-tls" not found
Jul 14 02:02:02.376140 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:02.375952    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls podName:c7dd9ccd-d174-4a35-a879-ad714f1d0c18 nodeName:}" failed. No retries permitted until 2026-07-14 02:02:10.375945629 +0000 UTC m=+51.058516444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls") pod "dns-default-qm78c" (UID: "c7dd9ccd-d174-4a35-a879-ad714f1d0c18") : secret "dns-default-metrics-tls" not found
Jul 14 02:02:10.433748 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:10.433701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:02:10.434240 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:10.433800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:02:10.434240 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:10.433869    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 02:02:10.434240 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:10.433889    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 02:02:10.434240 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:10.433891    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57fb4955f-5m882: secret "image-registry-tls" not found
Jul 14 02:02:10.434240 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:10.433950    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls podName:c7dd9ccd-d174-4a35-a879-ad714f1d0c18 nodeName:}" failed. No retries permitted until 2026-07-14 02:02:26.433934773 +0000 UTC m=+67.116505589 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls") pod "dns-default-qm78c" (UID: "c7dd9ccd-d174-4a35-a879-ad714f1d0c18") : secret "dns-default-metrics-tls" not found
Jul 14 02:02:10.434240 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:10.433964    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls podName:eca00a03-22f7-41d7-8633-f328a946aa58 nodeName:}" failed. No retries permitted until 2026-07-14 02:02:26.433957893 +0000 UTC m=+67.116528707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls") pod "image-registry-57fb4955f-5m882" (UID: "eca00a03-22f7-41d7-8633-f328a946aa58") : secret "image-registry-tls" not found
Jul 14 02:02:15.725163 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.725120    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-gwlst"]
Jul 14 02:02:15.727757 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.727730    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:15.730477 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.730448    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 14 02:02:15.730612 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.730541    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 14 02:02:15.731614 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.731574    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-f22pr\""
Jul 14 02:02:15.731735 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.731641    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 14 02:02:15.731735 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.731698    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 14 02:02:15.735826 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.735803    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 14 02:02:15.750731 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.750694    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-gwlst"]
Jul 14 02:02:15.767184 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.767132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c77e9abc-8454-4bb3-a76e-44313a61006e-trusted-ca\") pod \"console-operator-7866497494-gwlst\" (UID: \"c77e9abc-8454-4bb3-a76e-44313a61006e\") " pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:15.767384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.767198    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c77e9abc-8454-4bb3-a76e-44313a61006e-config\") pod \"console-operator-7866497494-gwlst\" (UID: \"c77e9abc-8454-4bb3-a76e-44313a61006e\") " pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:15.767384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.767283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm7c6\" (UniqueName: \"kubernetes.io/projected/c77e9abc-8454-4bb3-a76e-44313a61006e-kube-api-access-jm7c6\") pod \"console-operator-7866497494-gwlst\" (UID: \"c77e9abc-8454-4bb3-a76e-44313a61006e\") " pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:15.767384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.767343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c77e9abc-8454-4bb3-a76e-44313a61006e-serving-cert\") pod \"console-operator-7866497494-gwlst\" (UID: \"c77e9abc-8454-4bb3-a76e-44313a61006e\") " pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:15.833731 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.833690    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6tpf"]
Jul 14 02:02:15.835756 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.835734    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8"]
Jul 14 02:02:15.835909 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.835887    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6tpf"
Jul 14 02:02:15.837900 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.837875    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"]
Jul 14 02:02:15.838020 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.838003    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8"
Jul 14 02:02:15.839526 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.839502    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7d7pc\""
Jul 14 02:02:15.839645 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.839547    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"]
Jul 14 02:02:15.839739 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.839720    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"
Jul 14 02:02:15.839823 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.839808    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 14 02:02:15.839883 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.839808    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 14 02:02:15.840208 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.840191    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 14 02:02:15.840403 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.840383    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 14 02:02:15.840403 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.840412    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 14 02:02:15.840552 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.840493    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tl8q5\""
Jul 14 02:02:15.840630 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.840609    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 14 02:02:15.841527 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.841510    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:15.842011 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.841989    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 14 02:02:15.842114 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.842095    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 14 02:02:15.842263 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.842249    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9m9qm\""
Jul 14 02:02:15.843753 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.843733    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 14 02:02:15.843835 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.843734    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 02:02:15.844451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.844431    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 02:02:15.844598 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.844584    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wfwgt\""
Jul 14 02:02:15.844652 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.844629    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 14 02:02:15.848297 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.848274    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8"]
Jul 14 02:02:15.854054 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.854023    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6tpf"]
Jul 14 02:02:15.854193 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.854081    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"]
Jul 14 02:02:15.867429 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.867397    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"]
Jul 14 02:02:15.867970 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.867947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d7e99e2-72d9-4f00-9757-52076bf47f6b-serving-cert\") pod \"service-ca-operator-7695fc6c8c-sklw8\" (UID: \"6d7e99e2-72d9-4f00-9757-52076bf47f6b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8"
Jul 14 02:02:15.868064 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.867984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-nginx-conf\") pod \"networking-console-plugin-6cf856758c-8wjdc\" (UID: \"2284c8c8-e8b2-4a53-8fc3-208d1e0e9561\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"
Jul 14 02:02:15.868064 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.868050    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d7e99e2-72d9-4f00-9757-52076bf47f6b-config\") pod \"service-ca-operator-7695fc6c8c-sklw8\" (UID: \"6d7e99e2-72d9-4f00-9757-52076bf47f6b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8"
Jul 14 02:02:15.868189 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.868082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx65j\" (UniqueName: \"kubernetes.io/projected/cae3f82a-8916-4f1f-a48c-ef3d3d477b65-kube-api-access-jx65j\") pod \"volume-data-source-validator-78495597f6-s6tpf\" (UID: \"cae3f82a-8916-4f1f-a48c-ef3d3d477b65\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6tpf"
Jul 14 02:02:15.868189 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.868115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c77e9abc-8454-4bb3-a76e-44313a61006e-trusted-ca\") pod \"console-operator-7866497494-gwlst\" (UID: \"c77e9abc-8454-4bb3-a76e-44313a61006e\") " pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:15.868189 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.868160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c77e9abc-8454-4bb3-a76e-44313a61006e-config\") pod \"console-operator-7866497494-gwlst\" (UID: \"c77e9abc-8454-4bb3-a76e-44313a61006e\") " pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:15.868350 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.868229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm7c6\" (UniqueName: \"kubernetes.io/projected/c77e9abc-8454-4bb3-a76e-44313a61006e-kube-api-access-jm7c6\") pod \"console-operator-7866497494-gwlst\" (UID: \"c77e9abc-8454-4bb3-a76e-44313a61006e\") " pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:15.868350 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.868256    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4689d\" (UniqueName: \"kubernetes.io/projected/6d7e99e2-72d9-4f00-9757-52076bf47f6b-kube-api-access-4689d\") pod \"service-ca-operator-7695fc6c8c-sklw8\" (UID: \"6d7e99e2-72d9-4f00-9757-52076bf47f6b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8"
Jul 14 02:02:15.868350 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.868287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c77e9abc-8454-4bb3-a76e-44313a61006e-serving-cert\") pod \"console-operator-7866497494-gwlst\" (UID: \"c77e9abc-8454-4bb3-a76e-44313a61006e\") " pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:15.868350 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.868321    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pgm8g\" (UID: \"6f76e208-03bc-4869-ab22-47543479a78e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:15.868524 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.868384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8wjdc\" (UID: \"2284c8c8-e8b2-4a53-8fc3-208d1e0e9561\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"
Jul 14 02:02:15.868524 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.868453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk829\" (UniqueName: \"kubernetes.io/projected/6f76e208-03bc-4869-ab22-47543479a78e-kube-api-access-rk829\") pod \"cluster-monitoring-operator-5f7f494dd4-pgm8g\" (UID: \"6f76e208-03bc-4869-ab22-47543479a78e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:15.868524 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.868485    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f76e208-03bc-4869-ab22-47543479a78e-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-pgm8g\" (UID: \"6f76e208-03bc-4869-ab22-47543479a78e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:15.868901 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.868877    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c77e9abc-8454-4bb3-a76e-44313a61006e-config\") pod \"console-operator-7866497494-gwlst\" (UID: \"c77e9abc-8454-4bb3-a76e-44313a61006e\") " pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:15.868997 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.868977    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c77e9abc-8454-4bb3-a76e-44313a61006e-trusted-ca\") pod \"console-operator-7866497494-gwlst\" (UID: \"c77e9abc-8454-4bb3-a76e-44313a61006e\") " pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:15.872764 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.872742    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c77e9abc-8454-4bb3-a76e-44313a61006e-serving-cert\") pod \"console-operator-7866497494-gwlst\" (UID: \"c77e9abc-8454-4bb3-a76e-44313a61006e\") " pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:15.887793 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.887758    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm7c6\" (UniqueName: \"kubernetes.io/projected/c77e9abc-8454-4bb3-a76e-44313a61006e-kube-api-access-jm7c6\") pod \"console-operator-7866497494-gwlst\" (UID: \"c77e9abc-8454-4bb3-a76e-44313a61006e\") " pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:15.969010 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.968965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pgm8g\" (UID: \"6f76e208-03bc-4869-ab22-47543479a78e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:15.969010 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.969010    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8wjdc\" (UID: \"2284c8c8-e8b2-4a53-8fc3-208d1e0e9561\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"
Jul 14 02:02:15.969379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.969047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk829\" (UniqueName: \"kubernetes.io/projected/6f76e208-03bc-4869-ab22-47543479a78e-kube-api-access-rk829\") pod \"cluster-monitoring-operator-5f7f494dd4-pgm8g\" (UID: \"6f76e208-03bc-4869-ab22-47543479a78e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:15.969379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.969078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f76e208-03bc-4869-ab22-47543479a78e-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-pgm8g\" (UID: \"6f76e208-03bc-4869-ab22-47543479a78e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:15.969379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.969106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d7e99e2-72d9-4f00-9757-52076bf47f6b-serving-cert\") pod \"service-ca-operator-7695fc6c8c-sklw8\" (UID: \"6d7e99e2-72d9-4f00-9757-52076bf47f6b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8"
Jul 14 02:02:15.969379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.969126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-nginx-conf\") pod \"networking-console-plugin-6cf856758c-8wjdc\" (UID: \"2284c8c8-e8b2-4a53-8fc3-208d1e0e9561\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"
Jul 14 02:02:15.969379 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:15.969136    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 02:02:15.969379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.969206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d7e99e2-72d9-4f00-9757-52076bf47f6b-config\") pod \"service-ca-operator-7695fc6c8c-sklw8\" (UID: \"6d7e99e2-72d9-4f00-9757-52076bf47f6b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8"
Jul 14 02:02:15.969379 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:15.969214    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 02:02:15.969379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.969233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx65j\" (UniqueName: \"kubernetes.io/projected/cae3f82a-8916-4f1f-a48c-ef3d3d477b65-kube-api-access-jx65j\") pod \"volume-data-source-validator-78495597f6-s6tpf\" (UID: \"cae3f82a-8916-4f1f-a48c-ef3d3d477b65\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6tpf"
Jul 14 02:02:15.969379 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:15.969253    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls podName:6f76e208-03bc-4869-ab22-47543479a78e nodeName:}" failed. No retries permitted until 2026-07-14 02:02:16.469230188 +0000 UTC m=+57.151801016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pgm8g" (UID: "6f76e208-03bc-4869-ab22-47543479a78e") : secret "cluster-monitoring-operator-tls" not found
Jul 14 02:02:15.969379 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:15.969278    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert podName:2284c8c8-e8b2-4a53-8fc3-208d1e0e9561 nodeName:}" failed. No retries permitted until 2026-07-14 02:02:16.469268466 +0000 UTC m=+57.151839281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8wjdc" (UID: "2284c8c8-e8b2-4a53-8fc3-208d1e0e9561") : secret "networking-console-plugin-cert" not found
Jul 14 02:02:15.969379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.969357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4689d\" (UniqueName: \"kubernetes.io/projected/6d7e99e2-72d9-4f00-9757-52076bf47f6b-kube-api-access-4689d\") pod \"service-ca-operator-7695fc6c8c-sklw8\" (UID: \"6d7e99e2-72d9-4f00-9757-52076bf47f6b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8"
Jul 14 02:02:15.970018 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.969819    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d7e99e2-72d9-4f00-9757-52076bf47f6b-config\") pod \"service-ca-operator-7695fc6c8c-sklw8\" (UID: \"6d7e99e2-72d9-4f00-9757-52076bf47f6b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8"
Jul 14 02:02:15.970105 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.970082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6f76e208-03bc-4869-ab22-47543479a78e-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-pgm8g\" (UID: \"6f76e208-03bc-4869-ab22-47543479a78e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:15.970313 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.970295    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-nginx-conf\") pod \"networking-console-plugin-6cf856758c-8wjdc\" (UID: \"2284c8c8-e8b2-4a53-8fc3-208d1e0e9561\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"
Jul 14 02:02:15.971475 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.971457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d7e99e2-72d9-4f00-9757-52076bf47f6b-serving-cert\") pod \"service-ca-operator-7695fc6c8c-sklw8\" (UID: \"6d7e99e2-72d9-4f00-9757-52076bf47f6b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8"
Jul 14 02:02:15.981436 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.981353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4689d\" (UniqueName: \"kubernetes.io/projected/6d7e99e2-72d9-4f00-9757-52076bf47f6b-kube-api-access-4689d\") pod \"service-ca-operator-7695fc6c8c-sklw8\" (UID: \"6d7e99e2-72d9-4f00-9757-52076bf47f6b\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8"
Jul 14 02:02:15.982508 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.982484    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx65j\" (UniqueName: \"kubernetes.io/projected/cae3f82a-8916-4f1f-a48c-ef3d3d477b65-kube-api-access-jx65j\") pod \"volume-data-source-validator-78495597f6-s6tpf\" (UID: \"cae3f82a-8916-4f1f-a48c-ef3d3d477b65\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6tpf"
Jul 14 02:02:15.982644 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:15.982506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk829\" (UniqueName: \"kubernetes.io/projected/6f76e208-03bc-4869-ab22-47543479a78e-kube-api-access-rk829\") pod \"cluster-monitoring-operator-5f7f494dd4-pgm8g\" (UID: \"6f76e208-03bc-4869-ab22-47543479a78e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:16.036510 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:16.036457    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:16.147182 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:16.147140    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6tpf"
Jul 14 02:02:16.155253 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:16.155216    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8"
Jul 14 02:02:16.163736 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:16.163699    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-gwlst"]
Jul 14 02:02:16.166050 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:02:16.166018    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77e9abc_8454_4bb3_a76e_44313a61006e.slice/crio-d2b857e1f9eb573ed38502fa1ad930b9d17338adf1e4beb46bf1a799e8da0b3f WatchSource:0}: Error finding container d2b857e1f9eb573ed38502fa1ad930b9d17338adf1e4beb46bf1a799e8da0b3f: Status 404 returned error can't find the container with id d2b857e1f9eb573ed38502fa1ad930b9d17338adf1e4beb46bf1a799e8da0b3f
Jul 14 02:02:16.188604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:16.188566    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gwlst" event={"ID":"c77e9abc-8454-4bb3-a76e-44313a61006e","Type":"ContainerStarted","Data":"d2b857e1f9eb573ed38502fa1ad930b9d17338adf1e4beb46bf1a799e8da0b3f"}
Jul 14 02:02:16.310760 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:16.310725    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6tpf"]
Jul 14 02:02:16.314086 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:02:16.314052    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae3f82a_8916_4f1f_a48c_ef3d3d477b65.slice/crio-b43581321c9bd9d6a57e4ed90fccdf84cb08f4004a003e112b7ddbc2515960b9 WatchSource:0}: Error finding container b43581321c9bd9d6a57e4ed90fccdf84cb08f4004a003e112b7ddbc2515960b9: Status 404 returned error can't find the container with id b43581321c9bd9d6a57e4ed90fccdf84cb08f4004a003e112b7ddbc2515960b9
Jul 14 02:02:16.324937 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:16.324910    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8"]
Jul 14 02:02:16.328007 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:02:16.327982    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7e99e2_72d9_4f00_9757_52076bf47f6b.slice/crio-70689312241d42447af845c8c844f921e3c9b47ae3f2d4d9d9c2d95387ce6f71 WatchSource:0}: Error finding container 70689312241d42447af845c8c844f921e3c9b47ae3f2d4d9d9c2d95387ce6f71: Status 404 returned error can't find the container with id 70689312241d42447af845c8c844f921e3c9b47ae3f2d4d9d9c2d95387ce6f71
Jul 14 02:02:16.473461 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:16.473423    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pgm8g\" (UID: \"6f76e208-03bc-4869-ab22-47543479a78e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:16.473461 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:16.473467    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8wjdc\" (UID: \"2284c8c8-e8b2-4a53-8fc3-208d1e0e9561\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"
Jul 14 02:02:16.473706 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:16.473573    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 02:02:16.473706 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:16.473577    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 02:02:16.473706 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:16.473627    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert podName:2284c8c8-e8b2-4a53-8fc3-208d1e0e9561 nodeName:}" failed. No retries permitted until 2026-07-14 02:02:17.473613814 +0000 UTC m=+58.156184629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8wjdc" (UID: "2284c8c8-e8b2-4a53-8fc3-208d1e0e9561") : secret "networking-console-plugin-cert" not found
Jul 14 02:02:16.473706 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:16.473643    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls podName:6f76e208-03bc-4869-ab22-47543479a78e nodeName:}" failed. No retries permitted until 2026-07-14 02:02:17.473634864 +0000 UTC m=+58.156205679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pgm8g" (UID: "6f76e208-03bc-4869-ab22-47543479a78e") : secret "cluster-monitoring-operator-tls" not found
Jul 14 02:02:17.194786 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:17.194705    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8" event={"ID":"6d7e99e2-72d9-4f00-9757-52076bf47f6b","Type":"ContainerStarted","Data":"70689312241d42447af845c8c844f921e3c9b47ae3f2d4d9d9c2d95387ce6f71"}
Jul 14 02:02:17.196586 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:17.196555    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6tpf" event={"ID":"cae3f82a-8916-4f1f-a48c-ef3d3d477b65","Type":"ContainerStarted","Data":"b43581321c9bd9d6a57e4ed90fccdf84cb08f4004a003e112b7ddbc2515960b9"}
Jul 14 02:02:17.482455 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:17.482360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pgm8g\" (UID: \"6f76e208-03bc-4869-ab22-47543479a78e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:17.482455 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:17.482425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8wjdc\" (UID: \"2284c8c8-e8b2-4a53-8fc3-208d1e0e9561\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"
Jul 14 02:02:17.482685 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:17.482561    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 02:02:17.482685 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:17.482568    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 02:02:17.482685 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:17.482628    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert podName:2284c8c8-e8b2-4a53-8fc3-208d1e0e9561 nodeName:}" failed. No retries permitted until 2026-07-14 02:02:19.482608618 +0000 UTC m=+60.165179440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8wjdc" (UID: "2284c8c8-e8b2-4a53-8fc3-208d1e0e9561") : secret "networking-console-plugin-cert" not found
Jul 14 02:02:17.482848 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:17.482713    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls podName:6f76e208-03bc-4869-ab22-47543479a78e nodeName:}" failed. No retries permitted until 2026-07-14 02:02:19.48268686 +0000 UTC m=+60.165257675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pgm8g" (UID: "6f76e208-03bc-4869-ab22-47543479a78e") : secret "cluster-monitoring-operator-tls" not found
Jul 14 02:02:18.200582 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:18.200544    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6tpf" event={"ID":"cae3f82a-8916-4f1f-a48c-ef3d3d477b65","Type":"ContainerStarted","Data":"2143c42267490411dc2571beb68220566790181fdb039957c1ceaedace3c17fb"}
Jul 14 02:02:18.216859 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:18.216805    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-s6tpf" podStartSLOduration=1.932970692 podStartE2EDuration="3.216785305s" totalImagesPullingTime="1.283814613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:02:18.216057607 +0000 UTC m=+58.898628456" watchObservedRunningTime="2026-07-14 02:02:18.216785305 +0000 UTC m=+58.899356138"
Jul 14 02:02:19.204211 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:19.204160    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8" event={"ID":"6d7e99e2-72d9-4f00-9757-52076bf47f6b","Type":"ContainerStarted","Data":"e69c018b70bed92f32d46ef9b063584b3daeee8d820cd61d39585e9d25a1d5de"}
Jul 14 02:02:19.205888 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:19.205866    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/0.log"
Jul 14 02:02:19.206010 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:19.205903    2563 generic.go:356] "Generic (PLEG): container finished" podID="c77e9abc-8454-4bb3-a76e-44313a61006e" containerID="6abec79a0793f28faa38cfd1074341a5073fc835f3d923839f16d0f198a6e357" exitCode=255
Jul 14 02:02:19.206010 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:19.205981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gwlst" event={"ID":"c77e9abc-8454-4bb3-a76e-44313a61006e","Type":"ContainerDied","Data":"6abec79a0793f28faa38cfd1074341a5073fc835f3d923839f16d0f198a6e357"}
Jul 14 02:02:19.206189 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:19.206162    2563 scope.go:117] "RemoveContainer" containerID="6abec79a0793f28faa38cfd1074341a5073fc835f3d923839f16d0f198a6e357"
Jul 14 02:02:19.220105 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:19.220051    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8" podStartSLOduration=1.709534823 podStartE2EDuration="4.220032196s" totalImagesPullingTime="2.510497373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:02:19.219029413 +0000 UTC m=+59.901600298" watchObservedRunningTime="2026-07-14 02:02:19.220032196 +0000 UTC m=+59.902603033"
Jul 14 02:02:19.501079 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:19.500971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pgm8g\" (UID: \"6f76e208-03bc-4869-ab22-47543479a78e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:19.501079 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:19.501019    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8wjdc\" (UID: \"2284c8c8-e8b2-4a53-8fc3-208d1e0e9561\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"
Jul 14 02:02:19.501313 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:19.501155    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 02:02:19.501313 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:19.501177    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 02:02:19.501313 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:19.501228    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert podName:2284c8c8-e8b2-4a53-8fc3-208d1e0e9561 nodeName:}" failed. No retries permitted until 2026-07-14 02:02:23.501211054 +0000 UTC m=+64.183781870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8wjdc" (UID: "2284c8c8-e8b2-4a53-8fc3-208d1e0e9561") : secret "networking-console-plugin-cert" not found
Jul 14 02:02:19.501313 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:19.501273    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls podName:6f76e208-03bc-4869-ab22-47543479a78e nodeName:}" failed. No retries permitted until 2026-07-14 02:02:23.501253146 +0000 UTC m=+64.183823964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pgm8g" (UID: "6f76e208-03bc-4869-ab22-47543479a78e") : secret "cluster-monitoring-operator-tls" not found
Jul 14 02:02:20.210971 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:20.210942    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/1.log"
Jul 14 02:02:20.211441 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:20.211369    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/0.log"
Jul 14 02:02:20.211441 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:20.211412    2563 generic.go:356] "Generic (PLEG): container finished" podID="c77e9abc-8454-4bb3-a76e-44313a61006e" containerID="c83cc297ad591593333fe45e3713dd910dea9b43e5ee1422965720ba29c470f0" exitCode=255
Jul 14 02:02:20.211534 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:20.211503    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gwlst" event={"ID":"c77e9abc-8454-4bb3-a76e-44313a61006e","Type":"ContainerDied","Data":"c83cc297ad591593333fe45e3713dd910dea9b43e5ee1422965720ba29c470f0"}
Jul 14 02:02:20.211576 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:20.211566    2563 scope.go:117] "RemoveContainer" containerID="6abec79a0793f28faa38cfd1074341a5073fc835f3d923839f16d0f198a6e357"
Jul 14 02:02:20.211794 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:20.211779    2563 scope.go:117] "RemoveContainer" containerID="c83cc297ad591593333fe45e3713dd910dea9b43e5ee1422965720ba29c470f0"
Jul 14 02:02:20.211995 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:20.211973    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-gwlst_openshift-console-operator(c77e9abc-8454-4bb3-a76e-44313a61006e)\"" pod="openshift-console-operator/console-operator-7866497494-gwlst" podUID="c77e9abc-8454-4bb3-a76e-44313a61006e"
Jul 14 02:02:21.123420 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:21.123382    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l4xnb"
Jul 14 02:02:21.215756 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:21.215727    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/1.log"
Jul 14 02:02:21.216250 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:21.216122    2563 scope.go:117] "RemoveContainer" containerID="c83cc297ad591593333fe45e3713dd910dea9b43e5ee1422965720ba29c470f0"
Jul 14 02:02:21.216368 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:21.216344    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-gwlst_openshift-console-operator(c77e9abc-8454-4bb3-a76e-44313a61006e)\"" pod="openshift-console-operator/console-operator-7866497494-gwlst" podUID="c77e9abc-8454-4bb3-a76e-44313a61006e"
Jul 14 02:02:21.990240 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:21.990206    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-z88zw"]
Jul 14 02:02:22.018452 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.018407    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-z88zw"]
Jul 14 02:02:22.018612 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.018526    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-z88zw"
Jul 14 02:02:22.021154 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.021132    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 14 02:02:22.021388 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.021197    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 14 02:02:22.021487 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.021473    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zzb8w\""
Jul 14 02:02:22.021537 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.021492    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 14 02:02:22.021537 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.021525    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 14 02:02:22.122269 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.122233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4b115404-fb6b-474b-949a-0245e8a65e2f-signing-cabundle\") pod \"service-ca-79f68b9f4f-z88zw\" (UID: \"4b115404-fb6b-474b-949a-0245e8a65e2f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z88zw"
Jul 14 02:02:22.122432 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.122284    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhl6j\" (UniqueName: \"kubernetes.io/projected/4b115404-fb6b-474b-949a-0245e8a65e2f-kube-api-access-hhl6j\") pod \"service-ca-79f68b9f4f-z88zw\" (UID: \"4b115404-fb6b-474b-949a-0245e8a65e2f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z88zw"
Jul 14 02:02:22.122432 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.122309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4b115404-fb6b-474b-949a-0245e8a65e2f-signing-key\") pod \"service-ca-79f68b9f4f-z88zw\" (UID: \"4b115404-fb6b-474b-949a-0245e8a65e2f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z88zw"
Jul 14 02:02:22.223677 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.223642    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4b115404-fb6b-474b-949a-0245e8a65e2f-signing-cabundle\") pod \"service-ca-79f68b9f4f-z88zw\" (UID: \"4b115404-fb6b-474b-949a-0245e8a65e2f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z88zw"
Jul 14 02:02:22.223677 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.223680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhl6j\" (UniqueName: \"kubernetes.io/projected/4b115404-fb6b-474b-949a-0245e8a65e2f-kube-api-access-hhl6j\") pod \"service-ca-79f68b9f4f-z88zw\" (UID: \"4b115404-fb6b-474b-949a-0245e8a65e2f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z88zw"
Jul 14 02:02:22.224116 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.223700    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4b115404-fb6b-474b-949a-0245e8a65e2f-signing-key\") pod \"service-ca-79f68b9f4f-z88zw\" (UID: \"4b115404-fb6b-474b-949a-0245e8a65e2f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z88zw"
Jul 14 02:02:22.224322 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.224302    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4b115404-fb6b-474b-949a-0245e8a65e2f-signing-cabundle\") pod \"service-ca-79f68b9f4f-z88zw\" (UID: \"4b115404-fb6b-474b-949a-0245e8a65e2f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z88zw"
Jul 14 02:02:22.226160 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.226135    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4b115404-fb6b-474b-949a-0245e8a65e2f-signing-key\") pod \"service-ca-79f68b9f4f-z88zw\" (UID: \"4b115404-fb6b-474b-949a-0245e8a65e2f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z88zw"
Jul 14 02:02:22.235592 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.235564    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhl6j\" (UniqueName: \"kubernetes.io/projected/4b115404-fb6b-474b-949a-0245e8a65e2f-kube-api-access-hhl6j\") pod \"service-ca-79f68b9f4f-z88zw\" (UID: \"4b115404-fb6b-474b-949a-0245e8a65e2f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-z88zw"
Jul 14 02:02:22.327506 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.327473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-z88zw"
Jul 14 02:02:22.480290 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:22.480259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-z88zw"]
Jul 14 02:02:22.483346 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:02:22.483310    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b115404_fb6b_474b_949a_0245e8a65e2f.slice/crio-ef33d42da9192091443612f51864b06370d2292e74ae7ac2fdcb7f7000ef14c5 WatchSource:0}: Error finding container ef33d42da9192091443612f51864b06370d2292e74ae7ac2fdcb7f7000ef14c5: Status 404 returned error can't find the container with id ef33d42da9192091443612f51864b06370d2292e74ae7ac2fdcb7f7000ef14c5
Jul 14 02:02:23.222970 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:23.222932    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-z88zw" event={"ID":"4b115404-fb6b-474b-949a-0245e8a65e2f","Type":"ContainerStarted","Data":"fdf20ddb44d6afa700a9acf15283c7ec6bfcfa71e51d35a2a7721fac7d27d32e"}
Jul 14 02:02:23.223192 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:23.222980    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-z88zw" event={"ID":"4b115404-fb6b-474b-949a-0245e8a65e2f","Type":"ContainerStarted","Data":"ef33d42da9192091443612f51864b06370d2292e74ae7ac2fdcb7f7000ef14c5"}
Jul 14 02:02:23.244388 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:23.244330    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-z88zw" podStartSLOduration=2.244311437 podStartE2EDuration="2.244311437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:02:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:02:23.243659596 +0000 UTC m=+63.926230435" watchObservedRunningTime="2026-07-14 02:02:23.244311437 +0000 UTC m=+63.926882291"
Jul 14 02:02:23.535938 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:23.535846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pgm8g\" (UID: \"6f76e208-03bc-4869-ab22-47543479a78e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:23.535938 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:23.535893    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8wjdc\" (UID: \"2284c8c8-e8b2-4a53-8fc3-208d1e0e9561\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"
Jul 14 02:02:23.536128 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:23.536003    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 02:02:23.536128 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:23.536064    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls podName:6f76e208-03bc-4869-ab22-47543479a78e nodeName:}" failed. No retries permitted until 2026-07-14 02:02:31.536048353 +0000 UTC m=+72.218619168 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pgm8g" (UID: "6f76e208-03bc-4869-ab22-47543479a78e") : secret "cluster-monitoring-operator-tls" not found
Jul 14 02:02:23.536128 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:23.536086    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 02:02:23.536257 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:23.536139    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert podName:2284c8c8-e8b2-4a53-8fc3-208d1e0e9561 nodeName:}" failed. No retries permitted until 2026-07-14 02:02:31.536125499 +0000 UTC m=+72.218696313 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8wjdc" (UID: "2284c8c8-e8b2-4a53-8fc3-208d1e0e9561") : secret "networking-console-plugin-cert" not found
Jul 14 02:02:24.885622 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:24.885592    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tqxqv_08411450-7e59-47d7-86fd-a9df899dc964/dns-node-resolver/0.log"
Jul 14 02:02:25.482851 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:25.482815    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7ftxk_db745a62-430b-4b46-906f-761da9b8cdbe/node-ca/0.log"
Jul 14 02:02:25.555372 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:25.555333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs\") pod \"network-metrics-daemon-wnrxm\" (UID: \"cf6bc5ea-e0e1-415d-b47a-19bc897a699c\") " pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:02:25.555580 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:25.555419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k429n\" (UniqueName: \"kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n\") pod \"network-check-target-kwm2d\" (UID: \"73be1377-1b11-4b2f-b6bf-f27e04d7f3df\") " pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:02:25.555580 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:25.555492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:02:25.558527 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:25.558500    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 02:02:25.558657 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:25.558586    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 02:02:25.558997 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:25.558981    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 02:02:25.566272 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:25.566245    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 14 02:02:25.566529 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:25.566502    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs podName:cf6bc5ea-e0e1-415d-b47a-19bc897a699c nodeName:}" failed. No retries permitted until 2026-07-14 02:03:29.566475907 +0000 UTC m=+130.249046739 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs") pod "network-metrics-daemon-wnrxm" (UID: "cf6bc5ea-e0e1-415d-b47a-19bc897a699c") : secret "metrics-daemon-secret" not found
Jul 14 02:02:25.568659 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:25.568633    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68066f26-c4d5-4b49-8e00-88afb1882a06-original-pull-secret\") pod \"global-pull-secret-syncer-58548\" (UID: \"68066f26-c4d5-4b49-8e00-88afb1882a06\") " pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:02:25.569518 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:25.569488    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 02:02:25.579970 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:25.579946    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k429n\" (UniqueName: \"kubernetes.io/projected/73be1377-1b11-4b2f-b6bf-f27e04d7f3df-kube-api-access-k429n\") pod \"network-check-target-kwm2d\" (UID: \"73be1377-1b11-4b2f-b6bf-f27e04d7f3df\") " pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:02:25.761146 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:25.761034    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58548"
Jul 14 02:02:25.769617 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:25.769581    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mrlfg\""
Jul 14 02:02:25.777467 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:25.777430    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:02:25.922096 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:25.922063    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-58548"]
Jul 14 02:02:25.925595 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:02:25.925566    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68066f26_c4d5_4b49_8e00_88afb1882a06.slice/crio-fbb96dadd33537bd28e547d94c58f7e3f49e6ed0029ccacf656993c9bf324790 WatchSource:0}: Error finding container fbb96dadd33537bd28e547d94c58f7e3f49e6ed0029ccacf656993c9bf324790: Status 404 returned error can't find the container with id fbb96dadd33537bd28e547d94c58f7e3f49e6ed0029ccacf656993c9bf324790
Jul 14 02:02:25.941814 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:25.941779    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kwm2d"]
Jul 14 02:02:25.945233 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:02:25.945204    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73be1377_1b11_4b2f_b6bf_f27e04d7f3df.slice/crio-84998e0e6a981b487fb303012a9492803a987a0fe1d541b9cfbcb3bb2165260e WatchSource:0}: Error finding container 84998e0e6a981b487fb303012a9492803a987a0fe1d541b9cfbcb3bb2165260e: Status 404 returned error can't find the container with id 84998e0e6a981b487fb303012a9492803a987a0fe1d541b9cfbcb3bb2165260e
Jul 14 02:02:26.037227 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:26.037122    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:26.037227 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:26.037197    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:26.037577 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:26.037563    2563 scope.go:117] "RemoveContainer" containerID="c83cc297ad591593333fe45e3713dd910dea9b43e5ee1422965720ba29c470f0"
Jul 14 02:02:26.037747 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:26.037726    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-gwlst_openshift-console-operator(c77e9abc-8454-4bb3-a76e-44313a61006e)\"" pod="openshift-console-operator/console-operator-7866497494-gwlst" podUID="c77e9abc-8454-4bb3-a76e-44313a61006e"
Jul 14 02:02:26.236919 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:26.236876    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kwm2d" event={"ID":"73be1377-1b11-4b2f-b6bf-f27e04d7f3df","Type":"ContainerStarted","Data":"84998e0e6a981b487fb303012a9492803a987a0fe1d541b9cfbcb3bb2165260e"}
Jul 14 02:02:26.237914 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:26.237886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-58548" event={"ID":"68066f26-c4d5-4b49-8e00-88afb1882a06","Type":"ContainerStarted","Data":"fbb96dadd33537bd28e547d94c58f7e3f49e6ed0029ccacf656993c9bf324790"}
Jul 14 02:02:26.464266 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:26.464231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:02:26.464479 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:26.464409    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 02:02:26.464479 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:26.464426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:02:26.464479 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:26.464478    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls podName:c7dd9ccd-d174-4a35-a879-ad714f1d0c18 nodeName:}" failed. No retries permitted until 2026-07-14 02:02:58.464459962 +0000 UTC m=+99.147030778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls") pod "dns-default-qm78c" (UID: "c7dd9ccd-d174-4a35-a879-ad714f1d0c18") : secret "dns-default-metrics-tls" not found
Jul 14 02:02:26.464634 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:26.464541    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 02:02:26.464634 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:26.464553    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57fb4955f-5m882: secret "image-registry-tls" not found
Jul 14 02:02:26.464634 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:26.464599    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls podName:eca00a03-22f7-41d7-8633-f328a946aa58 nodeName:}" failed. No retries permitted until 2026-07-14 02:02:58.464583986 +0000 UTC m=+99.147154802 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls") pod "image-registry-57fb4955f-5m882" (UID: "eca00a03-22f7-41d7-8633-f328a946aa58") : secret "image-registry-tls" not found
Jul 14 02:02:26.478413 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:26.478286    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sdm9d_08730f0e-7030-486d-9d4b-62e2e12e9080/serve-healthcheck-canary/0.log"
Jul 14 02:02:31.257564 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:31.257533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kwm2d" event={"ID":"73be1377-1b11-4b2f-b6bf-f27e04d7f3df","Type":"ContainerStarted","Data":"3089c950903054aeaa59643136f1209c2e6719bc8924a42e159c674a6e36b4a4"}
Jul 14 02:02:31.257995 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:31.257668    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:02:31.274559 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:31.274322    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kwm2d" podStartSLOduration=67.727206473 podStartE2EDuration="1m11.274302676s" totalImagesPullingTime="3.547096203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:02:31.273546861 +0000 UTC m=+71.956117697" watchObservedRunningTime="2026-07-14 02:02:31.274302676 +0000 UTC m=+71.956873513"
Jul 14 02:02:31.613491 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:31.613451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pgm8g\" (UID: \"6f76e208-03bc-4869-ab22-47543479a78e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:31.613491 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:31.613497    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8wjdc\" (UID: \"2284c8c8-e8b2-4a53-8fc3-208d1e0e9561\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"
Jul 14 02:02:31.613742 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:31.613619    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 14 02:02:31.613742 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:31.613627    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 02:02:31.613742 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:31.613675    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert podName:2284c8c8-e8b2-4a53-8fc3-208d1e0e9561 nodeName:}" failed. No retries permitted until 2026-07-14 02:02:47.61365985 +0000 UTC m=+88.296230665 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8wjdc" (UID: "2284c8c8-e8b2-4a53-8fc3-208d1e0e9561") : secret "networking-console-plugin-cert" not found
Jul 14 02:02:31.613742 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:31.613699    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls podName:6f76e208-03bc-4869-ab22-47543479a78e nodeName:}" failed. No retries permitted until 2026-07-14 02:02:47.613681388 +0000 UTC m=+88.296252208 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-pgm8g" (UID: "6f76e208-03bc-4869-ab22-47543479a78e") : secret "cluster-monitoring-operator-tls" not found
Jul 14 02:02:32.262082 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:32.262046    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-58548" event={"ID":"68066f26-c4d5-4b49-8e00-88afb1882a06","Type":"ContainerStarted","Data":"cfff4405e8593b5a4ad7efb674759e34b307413bb63e7d3c1b49cd3a1157cbff"}
Jul 14 02:02:32.279392 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:32.279331    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-58548" podStartSLOduration=67.021553992 podStartE2EDuration="1m12.279314142s" totalImagesPullingTime="5.25776015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 02:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:02:32.278189757 +0000 UTC m=+72.960760603" watchObservedRunningTime="2026-07-14 02:02:32.279314142 +0000 UTC m=+72.961884979"
Jul 14 02:02:40.849152 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:40.849105    2563 scope.go:117] "RemoveContainer" containerID="c83cc297ad591593333fe45e3713dd910dea9b43e5ee1422965720ba29c470f0"
Jul 14 02:02:41.010154 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.010115    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zmk4h"]
Jul 14 02:02:41.013669 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.012401    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zmk4h"
Jul 14 02:02:41.014846 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.014818    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-m8n85\""
Jul 14 02:02:41.016056 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.016034    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 14 02:02:41.016192 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.016039    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 14 02:02:41.018871 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.018847    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lj5bc"]
Jul 14 02:02:41.020936 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.020920    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.023765 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.023738    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 02:02:41.024012 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.023754    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xfgbl\""
Jul 14 02:02:41.024012 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.023867    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 02:02:41.024231 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.023882    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zmk4h"]
Jul 14 02:02:41.024423 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.024405    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 02:02:41.024825 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.024804    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 02:02:41.039410 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.039378    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lj5bc"]
Jul 14 02:02:41.095324 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.095289    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpqv6\" (UniqueName: \"kubernetes.io/projected/4fb27c74-7a83-49cd-9a76-1bd067147060-kube-api-access-zpqv6\") pod \"migrator-7f59b54f6c-zmk4h\" (UID: \"4fb27c74-7a83-49cd-9a76-1bd067147060\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zmk4h"
Jul 14 02:02:41.095529 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.095337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cbbd949-4429-455c-a037-f521796d5270-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lj5bc\" (UID: \"4cbbd949-4429-455c-a037-f521796d5270\") " pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.095529 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.095373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cbbd949-4429-455c-a037-f521796d5270-crio-socket\") pod \"insights-runtime-extractor-lj5bc\" (UID: \"4cbbd949-4429-455c-a037-f521796d5270\") " pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.095529 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.095421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cbbd949-4429-455c-a037-f521796d5270-data-volume\") pod \"insights-runtime-extractor-lj5bc\" (UID: \"4cbbd949-4429-455c-a037-f521796d5270\") " pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.095529 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.095463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cbbd949-4429-455c-a037-f521796d5270-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lj5bc\" (UID: \"4cbbd949-4429-455c-a037-f521796d5270\") " pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.095529 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.095515    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9z5s\" (UniqueName: \"kubernetes.io/projected/4cbbd949-4429-455c-a037-f521796d5270-kube-api-access-h9z5s\") pod \"insights-runtime-extractor-lj5bc\" (UID: \"4cbbd949-4429-455c-a037-f521796d5270\") " pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.195895 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.195805    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cbbd949-4429-455c-a037-f521796d5270-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lj5bc\" (UID: \"4cbbd949-4429-455c-a037-f521796d5270\") " pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.195895 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.195860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cbbd949-4429-455c-a037-f521796d5270-crio-socket\") pod \"insights-runtime-extractor-lj5bc\" (UID: \"4cbbd949-4429-455c-a037-f521796d5270\") " pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.195895 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.195879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cbbd949-4429-455c-a037-f521796d5270-data-volume\") pod \"insights-runtime-extractor-lj5bc\" (UID: \"4cbbd949-4429-455c-a037-f521796d5270\") " pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.195895 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.195897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cbbd949-4429-455c-a037-f521796d5270-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lj5bc\" (UID: \"4cbbd949-4429-455c-a037-f521796d5270\") " pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.196249 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.195926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9z5s\" (UniqueName: \"kubernetes.io/projected/4cbbd949-4429-455c-a037-f521796d5270-kube-api-access-h9z5s\") pod \"insights-runtime-extractor-lj5bc\" (UID: \"4cbbd949-4429-455c-a037-f521796d5270\") " pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.196249 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.196041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpqv6\" (UniqueName: \"kubernetes.io/projected/4fb27c74-7a83-49cd-9a76-1bd067147060-kube-api-access-zpqv6\") pod \"migrator-7f59b54f6c-zmk4h\" (UID: \"4fb27c74-7a83-49cd-9a76-1bd067147060\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zmk4h"
Jul 14 02:02:41.196249 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.196163    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cbbd949-4429-455c-a037-f521796d5270-crio-socket\") pod \"insights-runtime-extractor-lj5bc\" (UID: \"4cbbd949-4429-455c-a037-f521796d5270\") " pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.196435 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.196417    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cbbd949-4429-455c-a037-f521796d5270-data-volume\") pod \"insights-runtime-extractor-lj5bc\" (UID: \"4cbbd949-4429-455c-a037-f521796d5270\") " pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.196579 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.196559    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cbbd949-4429-455c-a037-f521796d5270-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lj5bc\" (UID: \"4cbbd949-4429-455c-a037-f521796d5270\") " pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.198323 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.198302    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cbbd949-4429-455c-a037-f521796d5270-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lj5bc\" (UID: \"4cbbd949-4429-455c-a037-f521796d5270\") " pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.207842 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.207808    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpqv6\" (UniqueName: \"kubernetes.io/projected/4fb27c74-7a83-49cd-9a76-1bd067147060-kube-api-access-zpqv6\") pod \"migrator-7f59b54f6c-zmk4h\" (UID: \"4fb27c74-7a83-49cd-9a76-1bd067147060\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zmk4h"
Jul 14 02:02:41.208963 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.208943    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9z5s\" (UniqueName: \"kubernetes.io/projected/4cbbd949-4429-455c-a037-f521796d5270-kube-api-access-h9z5s\") pod \"insights-runtime-extractor-lj5bc\" (UID: \"4cbbd949-4429-455c-a037-f521796d5270\") " pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.293630 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.293599    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:02:41.294008 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.293993    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/1.log"
Jul 14 02:02:41.294069 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.294025    2563 generic.go:356] "Generic (PLEG): container finished" podID="c77e9abc-8454-4bb3-a76e-44313a61006e" containerID="6e36c6357302fa69a7c3ae079c1ba7c312b12ceb453231296c59e511ea8893ab" exitCode=255
Jul 14 02:02:41.294115 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.294064    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gwlst" event={"ID":"c77e9abc-8454-4bb3-a76e-44313a61006e","Type":"ContainerDied","Data":"6e36c6357302fa69a7c3ae079c1ba7c312b12ceb453231296c59e511ea8893ab"}
Jul 14 02:02:41.294115 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.294106    2563 scope.go:117] "RemoveContainer" containerID="c83cc297ad591593333fe45e3713dd910dea9b43e5ee1422965720ba29c470f0"
Jul 14 02:02:41.294488 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.294466    2563 scope.go:117] "RemoveContainer" containerID="6e36c6357302fa69a7c3ae079c1ba7c312b12ceb453231296c59e511ea8893ab"
Jul 14 02:02:41.294698 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:41.294675    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-gwlst_openshift-console-operator(c77e9abc-8454-4bb3-a76e-44313a61006e)\"" pod="openshift-console-operator/console-operator-7866497494-gwlst" podUID="c77e9abc-8454-4bb3-a76e-44313a61006e"
Jul 14 02:02:41.334958 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.334913    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zmk4h"
Jul 14 02:02:41.340461 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.340434    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lj5bc"
Jul 14 02:02:41.477674 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.477592    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zmk4h"]
Jul 14 02:02:41.480186 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:02:41.480139    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb27c74_7a83_49cd_9a76_1bd067147060.slice/crio-5c02a68a110ec123bc78c1a62d831cbb172e07376e95f2f848e7ca59b129815d WatchSource:0}: Error finding container 5c02a68a110ec123bc78c1a62d831cbb172e07376e95f2f848e7ca59b129815d: Status 404 returned error can't find the container with id 5c02a68a110ec123bc78c1a62d831cbb172e07376e95f2f848e7ca59b129815d
Jul 14 02:02:41.496597 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:41.496574    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lj5bc"]
Jul 14 02:02:41.499780 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:02:41.499752    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cbbd949_4429_455c_a037_f521796d5270.slice/crio-de12f12733204405bed507db896ae62138b26bf0a20bb9d05800bd9e716f5135 WatchSource:0}: Error finding container de12f12733204405bed507db896ae62138b26bf0a20bb9d05800bd9e716f5135: Status 404 returned error can't find the container with id de12f12733204405bed507db896ae62138b26bf0a20bb9d05800bd9e716f5135
Jul 14 02:02:42.301748 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:42.301621    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:02:42.303835 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:42.303792    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lj5bc" event={"ID":"4cbbd949-4429-455c-a037-f521796d5270","Type":"ContainerStarted","Data":"de12f12733204405bed507db896ae62138b26bf0a20bb9d05800bd9e716f5135"}
Jul 14 02:02:42.306401 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:42.306368    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zmk4h" event={"ID":"4fb27c74-7a83-49cd-9a76-1bd067147060","Type":"ContainerStarted","Data":"5c02a68a110ec123bc78c1a62d831cbb172e07376e95f2f848e7ca59b129815d"}
Jul 14 02:02:43.312105 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:43.312024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zmk4h" event={"ID":"4fb27c74-7a83-49cd-9a76-1bd067147060","Type":"ContainerStarted","Data":"a3e18367ecd58ff16ff43eb2c2396ecc60be8320c3f59042124f571da5d04ec7"}
Jul 14 02:02:43.312105 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:43.312095    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zmk4h" event={"ID":"4fb27c74-7a83-49cd-9a76-1bd067147060","Type":"ContainerStarted","Data":"2c230585014dfe518a41d3f17d608d3e1a3a91e4d71e700554d7f06dd249d71f"}
Jul 14 02:02:43.330216 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:43.330141    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-zmk4h" podStartSLOduration=1.9650288329999999 podStartE2EDuration="3.330121859s" totalImagesPullingTime="1.365093026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:02:43.328969696 +0000 UTC m=+84.011540556" watchObservedRunningTime="2026-07-14 02:02:43.330121859 +0000 UTC m=+84.012692749"
Jul 14 02:02:46.036810 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:46.036771    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:46.037235 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:46.036842    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:02:46.037235 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:46.037213    2563 scope.go:117] "RemoveContainer" containerID="6e36c6357302fa69a7c3ae079c1ba7c312b12ceb453231296c59e511ea8893ab"
Jul 14 02:02:46.037386 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:46.037366    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-gwlst_openshift-console-operator(c77e9abc-8454-4bb3-a76e-44313a61006e)\"" pod="openshift-console-operator/console-operator-7866497494-gwlst" podUID="c77e9abc-8454-4bb3-a76e-44313a61006e"
Jul 14 02:02:46.326094 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:46.326050    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lj5bc" event={"ID":"4cbbd949-4429-455c-a037-f521796d5270","Type":"ContainerStarted","Data":"83d02ca1a1ae6f79a1f5bb261d6bf000db334f2f75cf62c81037254a6ced13b6"}
Jul 14 02:02:46.326317 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:46.326126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lj5bc" event={"ID":"4cbbd949-4429-455c-a037-f521796d5270","Type":"ContainerStarted","Data":"98b03dd939bddc1aa4bbd089551f93fa52e287b912f001ed255986e0853dc0cd"}
Jul 14 02:02:47.654370 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:47.654315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pgm8g\" (UID: \"6f76e208-03bc-4869-ab22-47543479a78e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:47.654863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:47.654382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8wjdc\" (UID: \"2284c8c8-e8b2-4a53-8fc3-208d1e0e9561\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"
Jul 14 02:02:47.657023 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:47.656993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f76e208-03bc-4869-ab22-47543479a78e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-pgm8g\" (UID: \"6f76e208-03bc-4869-ab22-47543479a78e\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:47.657186 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:47.656997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2284c8c8-e8b2-4a53-8fc3-208d1e0e9561-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8wjdc\" (UID: \"2284c8c8-e8b2-4a53-8fc3-208d1e0e9561\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"
Jul 14 02:02:47.664590 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:47.664547    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9m9qm\""
Jul 14 02:02:47.669005 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:47.668969    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wfwgt\""
Jul 14 02:02:47.671914 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:47.671880    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"
Jul 14 02:02:47.676907 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:47.676880    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"
Jul 14 02:02:48.414362 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:48.414331    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-8wjdc"]
Jul 14 02:02:48.417401 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:02:48.417368    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2284c8c8_e8b2_4a53_8fc3_208d1e0e9561.slice/crio-94ef22d426153f433eeeae05c4e442496e6e528a40a09e910edde14c380a80b8 WatchSource:0}: Error finding container 94ef22d426153f433eeeae05c4e442496e6e528a40a09e910edde14c380a80b8: Status 404 returned error can't find the container with id 94ef22d426153f433eeeae05c4e442496e6e528a40a09e910edde14c380a80b8
Jul 14 02:02:48.429581 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:48.429550    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g"]
Jul 14 02:02:48.433763 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:02:48.433738    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f76e208_03bc_4869_ab22_47543479a78e.slice/crio-1aa105c3e663e2ec0294496e6b377729fd65362f4e5ccdec6e77ead41a9223fe WatchSource:0}: Error finding container 1aa105c3e663e2ec0294496e6b377729fd65362f4e5ccdec6e77ead41a9223fe: Status 404 returned error can't find the container with id 1aa105c3e663e2ec0294496e6b377729fd65362f4e5ccdec6e77ead41a9223fe
Jul 14 02:02:49.341773 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:49.341733    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g" event={"ID":"6f76e208-03bc-4869-ab22-47543479a78e","Type":"ContainerStarted","Data":"1aa105c3e663e2ec0294496e6b377729fd65362f4e5ccdec6e77ead41a9223fe"}
Jul 14 02:02:49.344021 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:49.343981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lj5bc" event={"ID":"4cbbd949-4429-455c-a037-f521796d5270","Type":"ContainerStarted","Data":"4f6071366d52317fee74904331a918e23b236c506989cae69d9405b322deea12"}
Jul 14 02:02:49.345252 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:49.345226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc" event={"ID":"2284c8c8-e8b2-4a53-8fc3-208d1e0e9561","Type":"ContainerStarted","Data":"94ef22d426153f433eeeae05c4e442496e6e528a40a09e910edde14c380a80b8"}
Jul 14 02:02:49.364586 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:49.364525    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lj5bc" podStartSLOduration=2.685557178 podStartE2EDuration="9.364501841s" totalImagesPullingTime="6.678944663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 02:02:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:02:49.363095997 +0000 UTC m=+90.045666884" watchObservedRunningTime="2026-07-14 02:02:49.364501841 +0000 UTC m=+90.047072679"
Jul 14 02:02:50.353731 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:50.353685    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc" event={"ID":"2284c8c8-e8b2-4a53-8fc3-208d1e0e9561","Type":"ContainerStarted","Data":"0c98b7f1e13fdda7327c397e1f0997c782dab7ff926404422f4a00c6a4e24e7b"}
Jul 14 02:02:50.368643 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:50.368585    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-8wjdc" podStartSLOduration=34.113829215 podStartE2EDuration="35.36856528s" totalImagesPullingTime="1.254736065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:02:50.367928299 +0000 UTC m=+91.050499137" watchObservedRunningTime="2026-07-14 02:02:50.36856528 +0000 UTC m=+91.051136120"
Jul 14 02:02:51.359673 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:51.359622    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g" event={"ID":"6f76e208-03bc-4869-ab22-47543479a78e","Type":"ContainerStarted","Data":"4e52e0212e719dd2351b0ec897d8f1c7ef5bc352d43910e2a4a30f54d61f4941"}
Jul 14 02:02:51.379265 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:51.379211    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-pgm8g" podStartSLOduration=34.056518004 podStartE2EDuration="36.379195274s" totalImagesPullingTime="2.32267727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:02:51.378554219 +0000 UTC m=+92.061125070" watchObservedRunningTime="2026-07-14 02:02:51.379195274 +0000 UTC m=+92.061766125"
Jul 14 02:02:54.278487 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.278447    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-r7dsg"]
Jul 14 02:02:54.281486 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.281466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg"
Jul 14 02:02:54.286093 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.286070    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zckcn\""
Jul 14 02:02:54.287458 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.287435    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 14 02:02:54.287666 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.287646    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 14 02:02:54.287759 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.287731    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 02:02:54.299013 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.298982    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-r7dsg"]
Jul 14 02:02:54.408345 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.408292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b297e6f-b3a6-499c-bd7e-81c033ed2471-metrics-client-ca\") pod \"prometheus-operator-64785b6675-r7dsg\" (UID: \"9b297e6f-b3a6-499c-bd7e-81c033ed2471\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg"
Jul 14 02:02:54.408524 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.408362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvpgm\" (UniqueName: \"kubernetes.io/projected/9b297e6f-b3a6-499c-bd7e-81c033ed2471-kube-api-access-gvpgm\") pod \"prometheus-operator-64785b6675-r7dsg\" (UID: \"9b297e6f-b3a6-499c-bd7e-81c033ed2471\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg"
Jul 14 02:02:54.408524 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.408453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b297e6f-b3a6-499c-bd7e-81c033ed2471-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-r7dsg\" (UID: \"9b297e6f-b3a6-499c-bd7e-81c033ed2471\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg"
Jul 14 02:02:54.408524 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.408488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b297e6f-b3a6-499c-bd7e-81c033ed2471-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-r7dsg\" (UID: \"9b297e6f-b3a6-499c-bd7e-81c033ed2471\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg"
Jul 14 02:02:54.509763 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.509723    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b297e6f-b3a6-499c-bd7e-81c033ed2471-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-r7dsg\" (UID: \"9b297e6f-b3a6-499c-bd7e-81c033ed2471\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg"
Jul 14 02:02:54.509936 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.509781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b297e6f-b3a6-499c-bd7e-81c033ed2471-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-r7dsg\" (UID: \"9b297e6f-b3a6-499c-bd7e-81c033ed2471\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg"
Jul 14 02:02:54.509936 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.509813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b297e6f-b3a6-499c-bd7e-81c033ed2471-metrics-client-ca\") pod \"prometheus-operator-64785b6675-r7dsg\" (UID: \"9b297e6f-b3a6-499c-bd7e-81c033ed2471\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg"
Jul 14 02:02:54.509936 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.509848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvpgm\" (UniqueName: \"kubernetes.io/projected/9b297e6f-b3a6-499c-bd7e-81c033ed2471-kube-api-access-gvpgm\") pod \"prometheus-operator-64785b6675-r7dsg\" (UID: \"9b297e6f-b3a6-499c-bd7e-81c033ed2471\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg"
Jul 14 02:02:54.510661 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.510633    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b297e6f-b3a6-499c-bd7e-81c033ed2471-metrics-client-ca\") pod \"prometheus-operator-64785b6675-r7dsg\" (UID: \"9b297e6f-b3a6-499c-bd7e-81c033ed2471\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg"
Jul 14 02:02:54.512375 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.512353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b297e6f-b3a6-499c-bd7e-81c033ed2471-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-r7dsg\" (UID: \"9b297e6f-b3a6-499c-bd7e-81c033ed2471\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg"
Jul 14 02:02:54.512375 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.512363    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b297e6f-b3a6-499c-bd7e-81c033ed2471-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-r7dsg\" (UID: \"9b297e6f-b3a6-499c-bd7e-81c033ed2471\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg"
Jul 14 02:02:54.518878 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.518845    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvpgm\" (UniqueName: \"kubernetes.io/projected/9b297e6f-b3a6-499c-bd7e-81c033ed2471-kube-api-access-gvpgm\") pod \"prometheus-operator-64785b6675-r7dsg\" (UID: \"9b297e6f-b3a6-499c-bd7e-81c033ed2471\") " pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg"
Jul 14 02:02:54.590941 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.590910    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg"
Jul 14 02:02:54.719752 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:54.719713    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-r7dsg"]
Jul 14 02:02:54.725986 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:02:54.725885    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b297e6f_b3a6_499c_bd7e_81c033ed2471.slice/crio-831055457c227d30cff161a1fb6a34283343e587d782d5b9a9643ac3ad6a1aef WatchSource:0}: Error finding container 831055457c227d30cff161a1fb6a34283343e587d782d5b9a9643ac3ad6a1aef: Status 404 returned error can't find the container with id 831055457c227d30cff161a1fb6a34283343e587d782d5b9a9643ac3ad6a1aef
Jul 14 02:02:55.374920 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:55.374884    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg" event={"ID":"9b297e6f-b3a6-499c-bd7e-81c033ed2471","Type":"ContainerStarted","Data":"831055457c227d30cff161a1fb6a34283343e587d782d5b9a9643ac3ad6a1aef"}
Jul 14 02:02:56.380027 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:56.379981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg" event={"ID":"9b297e6f-b3a6-499c-bd7e-81c033ed2471","Type":"ContainerStarted","Data":"42ebb6201d8b0da82cfa86183f129598cb88d0cbb8db4ec3f973075d9ea4a00b"}
Jul 14 02:02:56.380437 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:56.380057    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg" event={"ID":"9b297e6f-b3a6-499c-bd7e-81c033ed2471","Type":"ContainerStarted","Data":"0180aa467abf3dede4b0595dabe35e4f96c23a9a3ee9cb53e93cda9edbc3adea"}
Jul 14 02:02:56.396140 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:56.396089    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-r7dsg" podStartSLOduration=1.098321124 podStartE2EDuration="2.396071679s" totalImagesPullingTime="1.297750555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:02:56.395386595 +0000 UTC m=+97.077957444" watchObservedRunningTime="2026-07-14 02:02:56.396071679 +0000 UTC m=+97.078642515"
Jul 14 02:02:56.849424 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:56.849396    2563 scope.go:117] "RemoveContainer" containerID="6e36c6357302fa69a7c3ae079c1ba7c312b12ceb453231296c59e511ea8893ab"
Jul 14 02:02:56.849655 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:56.849555    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-gwlst_openshift-console-operator(c77e9abc-8454-4bb3-a76e-44313a61006e)\"" pod="openshift-console-operator/console-operator-7866497494-gwlst" podUID="c77e9abc-8454-4bb3-a76e-44313a61006e"
Jul 14 02:02:58.545989 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.545942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:02:58.546454 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.546010    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:02:58.549039 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.549007    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c7dd9ccd-d174-4a35-a879-ad714f1d0c18-metrics-tls\") pod \"dns-default-qm78c\" (UID: \"c7dd9ccd-d174-4a35-a879-ad714f1d0c18\") " pod="openshift-dns/dns-default-qm78c"
Jul 14 02:02:58.549217 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.549073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls\") pod \"image-registry-57fb4955f-5m882\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") " pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:02:58.626810 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.626771    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"]
Jul 14 02:02:58.631995 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.631966    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"
Jul 14 02:02:58.635027 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.634811    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7j7gh\""
Jul 14 02:02:58.635027 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.634911    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 14 02:02:58.635529 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.635369    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 14 02:02:58.643780 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.643748    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"]
Jul 14 02:02:58.647360 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.647328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7214052c-b032-4421-ae2f-64709c76546b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-lqpqr\" (UID: \"7214052c-b032-4421-ae2f-64709c76546b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"
Jul 14 02:02:58.647499 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.647399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7214052c-b032-4421-ae2f-64709c76546b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-lqpqr\" (UID: \"7214052c-b032-4421-ae2f-64709c76546b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"
Jul 14 02:02:58.647499 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.647460    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7214052c-b032-4421-ae2f-64709c76546b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-lqpqr\" (UID: \"7214052c-b032-4421-ae2f-64709c76546b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"
Jul 14 02:02:58.647611 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.647501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc276\" (UniqueName: \"kubernetes.io/projected/7214052c-b032-4421-ae2f-64709c76546b-kube-api-access-jc276\") pod \"openshift-state-metrics-84bd68b896-lqpqr\" (UID: \"7214052c-b032-4421-ae2f-64709c76546b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"
Jul 14 02:02:58.654518 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.654488    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b75jn"]
Jul 14 02:02:58.658567 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.658540    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.661004 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.660976    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 02:02:58.661323 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.661302    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 02:02:58.661450 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.661340    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 02:02:58.661450 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.661424    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pgskw\""
Jul 14 02:02:58.748636 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.748593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7214052c-b032-4421-ae2f-64709c76546b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-lqpqr\" (UID: \"7214052c-b032-4421-ae2f-64709c76546b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"
Jul 14 02:02:58.748858 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.748653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-node-exporter-tls\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.748858 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.748736    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7214052c-b032-4421-ae2f-64709c76546b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-lqpqr\" (UID: \"7214052c-b032-4421-ae2f-64709c76546b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"
Jul 14 02:02:58.748858 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.748823    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-node-exporter-accelerators-collector-config\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.749033 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.748906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc276\" (UniqueName: \"kubernetes.io/projected/7214052c-b032-4421-ae2f-64709c76546b-kube-api-access-jc276\") pod \"openshift-state-metrics-84bd68b896-lqpqr\" (UID: \"7214052c-b032-4421-ae2f-64709c76546b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"
Jul 14 02:02:58.749033 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.748934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-sys\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.749366 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.749327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-node-exporter-wtmp\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.749494 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.749400    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7214052c-b032-4421-ae2f-64709c76546b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-lqpqr\" (UID: \"7214052c-b032-4421-ae2f-64709c76546b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"
Jul 14 02:02:58.749494 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.749435    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-metrics-client-ca\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.749494 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.749477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rwkm\" (UniqueName: \"kubernetes.io/projected/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-kube-api-access-6rwkm\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.749651 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.749504    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7214052c-b032-4421-ae2f-64709c76546b-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-lqpqr\" (UID: \"7214052c-b032-4421-ae2f-64709c76546b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"
Jul 14 02:02:58.749651 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.749554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-node-exporter-textfile\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.749651 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:58.749573    2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 14 02:02:58.749651 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.749593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.749651 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:58.749648    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7214052c-b032-4421-ae2f-64709c76546b-openshift-state-metrics-tls podName:7214052c-b032-4421-ae2f-64709c76546b nodeName:}" failed. No retries permitted until 2026-07-14 02:02:59.249614452 +0000 UTC m=+99.932185285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7214052c-b032-4421-ae2f-64709c76546b-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-lqpqr" (UID: "7214052c-b032-4421-ae2f-64709c76546b") : secret "openshift-state-metrics-tls" not found
Jul 14 02:02:58.749906 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.749712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-root\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.751605 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.751581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7214052c-b032-4421-ae2f-64709c76546b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-lqpqr\" (UID: \"7214052c-b032-4421-ae2f-64709c76546b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"
Jul 14 02:02:58.760232 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.760200    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc276\" (UniqueName: \"kubernetes.io/projected/7214052c-b032-4421-ae2f-64709c76546b-kube-api-access-jc276\") pod \"openshift-state-metrics-84bd68b896-lqpqr\" (UID: \"7214052c-b032-4421-ae2f-64709c76546b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"
Jul 14 02:02:58.806939 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.806845    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fmxrd\""
Jul 14 02:02:58.815000 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.814962    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:02:58.826506 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.826353    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qrrwt\""
Jul 14 02:02:58.834601 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.834560    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qm78c"
Jul 14 02:02:58.850211 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.850122    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-node-exporter-wtmp\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.850978 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.850329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-metrics-client-ca\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.850978 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.850386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rwkm\" (UniqueName: \"kubernetes.io/projected/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-kube-api-access-6rwkm\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.850978 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.850422    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-node-exporter-textfile\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.850978 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.850431    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-node-exporter-wtmp\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.850978 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.850466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.850978 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.850504    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-root\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.850978 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.850539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-node-exporter-tls\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.850978 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.850613    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-node-exporter-accelerators-collector-config\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.850978 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.850651    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-sys\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.850978 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.850666    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-root\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.850978 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.850699    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-node-exporter-textfile\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.850978 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.850727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-sys\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.850978 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.850776    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-metrics-client-ca\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.851721 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.851279    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-node-exporter-accelerators-collector-config\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.853541 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.853519    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-node-exporter-tls\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.853753 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.853731    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.859108 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.859088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rwkm\" (UniqueName: \"kubernetes.io/projected/f7d1665c-708b-476b-bc13-3a3e0b6ecb8c-kube-api-access-6rwkm\") pod \"node-exporter-b75jn\" (UID: \"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c\") " pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.969644 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.969604    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b75jn"
Jul 14 02:02:58.984209 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:58.984176    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57fb4955f-5m882"]
Jul 14 02:02:58.986385 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:02:58.986352    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d1665c_708b_476b_bc13_3a3e0b6ecb8c.slice/crio-9dbc9745d9d594eeef89e08f42513c1e801c79a8e68e7b45c08171e3662614a1 WatchSource:0}: Error finding container 9dbc9745d9d594eeef89e08f42513c1e801c79a8e68e7b45c08171e3662614a1: Status 404 returned error can't find the container with id 9dbc9745d9d594eeef89e08f42513c1e801c79a8e68e7b45c08171e3662614a1
Jul 14 02:02:58.988266 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:02:58.988137    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca00a03_22f7_41d7_8633_f328a946aa58.slice/crio-9155ca261f6ffa9b03d7f8059ad30ec8699949dec7e7c4c2de4c4a6d3de16d7f WatchSource:0}: Error finding container 9155ca261f6ffa9b03d7f8059ad30ec8699949dec7e7c4c2de4c4a6d3de16d7f: Status 404 returned error can't find the container with id 9155ca261f6ffa9b03d7f8059ad30ec8699949dec7e7c4c2de4c4a6d3de16d7f
Jul 14 02:02:59.011092 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.011060    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qm78c"]
Jul 14 02:02:59.019100 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:02:59.019055    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7dd9ccd_d174_4a35_a879_ad714f1d0c18.slice/crio-55ae08190a61553a309e969f23651be9e4fd3b9083d98c0ecc342bd41bba2833 WatchSource:0}: Error finding container 55ae08190a61553a309e969f23651be9e4fd3b9083d98c0ecc342bd41bba2833: Status 404 returned error can't find the container with id 55ae08190a61553a309e969f23651be9e4fd3b9083d98c0ecc342bd41bba2833
Jul 14 02:02:59.255128 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.255086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7214052c-b032-4421-ae2f-64709c76546b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-lqpqr\" (UID: \"7214052c-b032-4421-ae2f-64709c76546b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"
Jul 14 02:02:59.257482 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.257450    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7214052c-b032-4421-ae2f-64709c76546b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-lqpqr\" (UID: \"7214052c-b032-4421-ae2f-64709c76546b\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"
Jul 14 02:02:59.394588 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.394479    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qm78c" event={"ID":"c7dd9ccd-d174-4a35-a879-ad714f1d0c18","Type":"ContainerStarted","Data":"55ae08190a61553a309e969f23651be9e4fd3b9083d98c0ecc342bd41bba2833"}
Jul 14 02:02:59.396022 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.395988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57fb4955f-5m882" event={"ID":"eca00a03-22f7-41d7-8633-f328a946aa58","Type":"ContainerStarted","Data":"e846636e51b3477f6418c2d616f7d73a3f2f2b14ae3525b46459c01265f002d2"}
Jul 14 02:02:59.396183 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.396045    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:02:59.396183 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.396067    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57fb4955f-5m882" event={"ID":"eca00a03-22f7-41d7-8633-f328a946aa58","Type":"ContainerStarted","Data":"9155ca261f6ffa9b03d7f8059ad30ec8699949dec7e7c4c2de4c4a6d3de16d7f"}
Jul 14 02:02:59.398412 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.398380    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b75jn" event={"ID":"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c","Type":"ContainerStarted","Data":"9dbc9745d9d594eeef89e08f42513c1e801c79a8e68e7b45c08171e3662614a1"}
Jul 14 02:02:59.417564 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.417502    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57fb4955f-5m882" podStartSLOduration=99.417485432 podStartE2EDuration="1m39.417485432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:01:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:02:59.416727408 +0000 UTC m=+100.099298246" watchObservedRunningTime="2026-07-14 02:02:59.417485432 +0000 UTC m=+100.100056276"
Jul 14 02:02:59.545399 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.545358    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"
Jul 14 02:02:59.670684 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.667624    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 02:02:59.675115 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.673979    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.685794 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.676778    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lgljr\""
Jul 14 02:02:59.685794 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.677063    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 14 02:02:59.690270 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.689329    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 02:02:59.690270 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.689600    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 14 02:02:59.690270 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.689867    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 14 02:02:59.690270 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.690090    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 14 02:02:59.690764 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.690744    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 14 02:02:59.691149 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.691132    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 14 02:02:59.691739 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.691302    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 14 02:02:59.691739 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.691486    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 14 02:02:59.691739 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.691538    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 14 02:02:59.762361 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.762273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f752a1c-fce1-48df-91b8-b22c53a58040-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.762361 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.762356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.762589 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.762384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-web-config\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.762589 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.762414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f752a1c-fce1-48df-91b8-b22c53a58040-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.762589 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.762444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.762589 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.762469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.762589 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.762512    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9qrn\" (UniqueName: \"kubernetes.io/projected/0f752a1c-fce1-48df-91b8-b22c53a58040-kube-api-access-h9qrn\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.762589 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.762544    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.762589 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.762567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f752a1c-fce1-48df-91b8-b22c53a58040-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.763057 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.762592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.763057 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.762635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f752a1c-fce1-48df-91b8-b22c53a58040-config-out\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.763057 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.762659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f752a1c-fce1-48df-91b8-b22c53a58040-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.763057 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.762696    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-config-volume\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.795056 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.794842    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr"]
Jul 14 02:02:59.864334 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.864301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f752a1c-fce1-48df-91b8-b22c53a58040-config-out\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.864484 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.864346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f752a1c-fce1-48df-91b8-b22c53a58040-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.864484 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.864383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-config-volume\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.864484 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.864422    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f752a1c-fce1-48df-91b8-b22c53a58040-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.864484 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.864464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.864698 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.864488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-web-config\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.864698 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.864525    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f752a1c-fce1-48df-91b8-b22c53a58040-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.864698 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.864560    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.864698 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.864589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.864698 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.864635    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9qrn\" (UniqueName: \"kubernetes.io/projected/0f752a1c-fce1-48df-91b8-b22c53a58040-kube-api-access-h9qrn\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.864698 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.864665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.864698 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.864689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f752a1c-fce1-48df-91b8-b22c53a58040-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.865046 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.864717    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.866771 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:59.865381    2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 14 02:02:59.866771 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:02:59.865459    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-main-tls podName:0f752a1c-fce1-48df-91b8-b22c53a58040 nodeName:}" failed. No retries permitted until 2026-07-14 02:03:00.365439214 +0000 UTC m=+101.048010055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0f752a1c-fce1-48df-91b8-b22c53a58040") : secret "alertmanager-main-tls" not found
Jul 14 02:02:59.866771 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.865673    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f752a1c-fce1-48df-91b8-b22c53a58040-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.866771 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.866338    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f752a1c-fce1-48df-91b8-b22c53a58040-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.866771 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.866665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f752a1c-fce1-48df-91b8-b22c53a58040-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.868850 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.868826    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.869397 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.869351    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-web-config\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.870951 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.870927    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-config-volume\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.871352 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.871324    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f752a1c-fce1-48df-91b8-b22c53a58040-config-out\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.871435 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.871407    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.872509 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.872211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f752a1c-fce1-48df-91b8-b22c53a58040-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.872743 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.872721    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.873354 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.873253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:02:59.875268 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:02:59.875246    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9qrn\" (UniqueName: \"kubernetes.io/projected/0f752a1c-fce1-48df-91b8-b22c53a58040-kube-api-access-h9qrn\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:03:00.370380 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:00.370341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:03:00.373096 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:00.373063    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:03:00.413244 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:00.413123    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr" event={"ID":"7214052c-b032-4421-ae2f-64709c76546b","Type":"ContainerStarted","Data":"2ee89154cdcf59b0697f7bb6bf2fd83e0a4011db3855c8044088435d975329cc"}
Jul 14 02:03:00.413425 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:00.413282    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr" event={"ID":"7214052c-b032-4421-ae2f-64709c76546b","Type":"ContainerStarted","Data":"8e2b76f7c669c9d81e2ae834444ec487106826a78a194de16e7d364e85079e26"}
Jul 14 02:03:00.413425 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:00.413317    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr" event={"ID":"7214052c-b032-4421-ae2f-64709c76546b","Type":"ContainerStarted","Data":"72ae84ad00bb303500e7a394df60fbf93c32d38f82c72b3bf8495400cf9c5f45"}
Jul 14 02:03:00.418202 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:00.415601    2563 generic.go:356] "Generic (PLEG): container finished" podID="f7d1665c-708b-476b-bc13-3a3e0b6ecb8c" containerID="b20e8f3e72250bc293b649d10d2deb8df762498728b666a46c8c3eb202d2c7ce" exitCode=0
Jul 14 02:03:00.418202 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:00.415642    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b75jn" event={"ID":"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c","Type":"ContainerDied","Data":"b20e8f3e72250bc293b649d10d2deb8df762498728b666a46c8c3eb202d2c7ce"}
Jul 14 02:03:00.605231 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:00.605196    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:03:00.763019 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:00.762983    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 02:03:01.126059 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:03:01.126023    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f752a1c_fce1_48df_91b8_b22c53a58040.slice/crio-bc03ed8eb5206038f8d90dcdf5a0902693a1911c7ec7bbb1209999189f3dad6b WatchSource:0}: Error finding container bc03ed8eb5206038f8d90dcdf5a0902693a1911c7ec7bbb1209999189f3dad6b: Status 404 returned error can't find the container with id bc03ed8eb5206038f8d90dcdf5a0902693a1911c7ec7bbb1209999189f3dad6b
Jul 14 02:03:01.423064 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.422856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qm78c" event={"ID":"c7dd9ccd-d174-4a35-a879-ad714f1d0c18","Type":"ContainerStarted","Data":"2777f044fe2255b43643dffbe37abe5b13634a1cd45d82a99fd375fdfeb86e89"}
Jul 14 02:03:01.423064 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.422917    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qm78c" event={"ID":"c7dd9ccd-d174-4a35-a879-ad714f1d0c18","Type":"ContainerStarted","Data":"47a0a47c51cd4d71b8a716b4c80f397dde1ffdc4535d87cfe063be4f5cf9a8c0"}
Jul 14 02:03:01.423064 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.422947    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qm78c"
Jul 14 02:03:01.425520 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.425425    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b75jn" event={"ID":"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c","Type":"ContainerStarted","Data":"79a409023430fae6dadb5183b6eeaded46be2aa2890d4f48157ebdb994f1ff5e"}
Jul 14 02:03:01.425520 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.425490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b75jn" event={"ID":"f7d1665c-708b-476b-bc13-3a3e0b6ecb8c","Type":"ContainerStarted","Data":"65be117934252c865b38d6d0a5de655c55a8a83772fee751f753248d81ed8d67"}
Jul 14 02:03:01.426762 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.426733    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f752a1c-fce1-48df-91b8-b22c53a58040","Type":"ContainerStarted","Data":"bc03ed8eb5206038f8d90dcdf5a0902693a1911c7ec7bbb1209999189f3dad6b"}
Jul 14 02:03:01.464003 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.463893    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qm78c" podStartSLOduration=65.309017293 podStartE2EDuration="1m7.463873335s" totalImagesPullingTime="2.154856042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:03:01.463428295 +0000 UTC m=+102.145999156" watchObservedRunningTime="2026-07-14 02:03:01.463873335 +0000 UTC m=+102.146444173"
Jul 14 02:03:01.496597 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.496525    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b75jn" podStartSLOduration=2.229069064 podStartE2EDuration="3.496506414s" totalImagesPullingTime="1.198727237s" totalInitContainerRuntime="68.710113ms" isStatefulPod=true podCreationTimestamp="2026-07-14 02:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:03:01.49505596 +0000 UTC m=+102.177626798" watchObservedRunningTime="2026-07-14 02:03:01.496506414 +0000 UTC m=+102.179077252"
Jul 14 02:03:01.651504 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.651463    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"]
Jul 14 02:03:01.656096 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.656069    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.661105 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.660567    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 14 02:03:01.661105 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.660660    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 14 02:03:01.661105 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.660879    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 14 02:03:01.661105 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.660932    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-djse32e76lk87\""
Jul 14 02:03:01.661105 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.660882    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 14 02:03:01.661500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.661137    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kvrn2\""
Jul 14 02:03:01.661500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.661218    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 14 02:03:01.672676 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.672644    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"]
Jul 14 02:03:01.684654 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.684558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-grpc-tls\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.684654 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.684629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.684876 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.684668    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csvjq\" (UniqueName: \"kubernetes.io/projected/342ddfbe-e3ea-4848-a01b-cfbc26140362-kube-api-access-csvjq\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.684876 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.684700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.684876 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.684734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-thanos-querier-tls\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.684876 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.684792    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.684876 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.684835    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.685198 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.684902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/342ddfbe-e3ea-4848-a01b-cfbc26140362-metrics-client-ca\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.785888 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.785834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/342ddfbe-e3ea-4848-a01b-cfbc26140362-metrics-client-ca\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.786365 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.785897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-grpc-tls\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.786365 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.785941    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.786365 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.785971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csvjq\" (UniqueName: \"kubernetes.io/projected/342ddfbe-e3ea-4848-a01b-cfbc26140362-kube-api-access-csvjq\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.786365 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.786002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.786365 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.786033    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-thanos-querier-tls\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.786365 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.786074    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.786365 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.786108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.788301 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.787944    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/342ddfbe-e3ea-4848-a01b-cfbc26140362-metrics-client-ca\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.790004 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.789972    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.790004 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.789997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-grpc-tls\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.791338 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.791277    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.792374 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.791943    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-thanos-querier-tls\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.792374 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.792337    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.794325 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.794286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/342ddfbe-e3ea-4848-a01b-cfbc26140362-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.796395 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.796369    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csvjq\" (UniqueName: \"kubernetes.io/projected/342ddfbe-e3ea-4848-a01b-cfbc26140362-kube-api-access-csvjq\") pod \"thanos-querier-5f95cccbb6-8gntx\" (UID: \"342ddfbe-e3ea-4848-a01b-cfbc26140362\") " pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:01.971600 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:01.971513    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:02.218146 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:02.218024    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"]
Jul 14 02:03:02.265199 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:02.265089    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kwm2d"
Jul 14 02:03:02.433115 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:02.433077    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr" event={"ID":"7214052c-b032-4421-ae2f-64709c76546b","Type":"ContainerStarted","Data":"c96810b1bf76c0a3743b8aa70545308f03c0b59aafc402c84c767c44c603009f"}
Jul 14 02:03:02.449761 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:03:02.449723    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342ddfbe_e3ea_4848_a01b_cfbc26140362.slice/crio-9a29426a24c841630371788e6f660e6c72b6d9ed5a8ff89d684d9b565968861f WatchSource:0}: Error finding container 9a29426a24c841630371788e6f660e6c72b6d9ed5a8ff89d684d9b565968861f: Status 404 returned error can't find the container with id 9a29426a24c841630371788e6f660e6c72b6d9ed5a8ff89d684d9b565968861f
Jul 14 02:03:02.452039 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:02.451993    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-lqpqr" podStartSLOduration=2.538857686 podStartE2EDuration="4.45197604s" totalImagesPullingTime="1.913118354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:03:02.450947063 +0000 UTC m=+103.133517924" watchObservedRunningTime="2026-07-14 02:03:02.45197604 +0000 UTC m=+103.134546877"
Jul 14 02:03:02.799130 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:02.799043    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57fb4955f-5m882"]
Jul 14 02:03:03.002227 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.002181    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7456cb6c-fvlrl"]
Jul 14 02:03:03.005526 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.005500    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.009116 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.009087    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 14 02:03:03.009384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.009369    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 14 02:03:03.009384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.009375    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 14 02:03:03.009717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.009701    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-62k9f\""
Jul 14 02:03:03.009776 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.009734    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b7lknrk03vt9v\""
Jul 14 02:03:03.009951 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.009937    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 14 02:03:03.019420 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.019386    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7456cb6c-fvlrl"]
Jul 14 02:03:03.099265 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.099226    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4a4ef38e-4c51-45f7-8be5-355023a1cd37-secret-metrics-server-tls\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.099473 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.099281    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a4ef38e-4c51-45f7-8be5-355023a1cd37-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.099473 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.099403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m78d7\" (UniqueName: \"kubernetes.io/projected/4a4ef38e-4c51-45f7-8be5-355023a1cd37-kube-api-access-m78d7\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.099473 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.099448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4a4ef38e-4c51-45f7-8be5-355023a1cd37-metrics-server-audit-profiles\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.099642 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.099507    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4a4ef38e-4c51-45f7-8be5-355023a1cd37-secret-metrics-server-client-certs\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.099642 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.099533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a4ef38e-4c51-45f7-8be5-355023a1cd37-client-ca-bundle\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.099642 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.099580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4a4ef38e-4c51-45f7-8be5-355023a1cd37-audit-log\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.200989 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.200947    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m78d7\" (UniqueName: \"kubernetes.io/projected/4a4ef38e-4c51-45f7-8be5-355023a1cd37-kube-api-access-m78d7\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.201225 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.200997    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4a4ef38e-4c51-45f7-8be5-355023a1cd37-metrics-server-audit-profiles\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.201225 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.201045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4a4ef38e-4c51-45f7-8be5-355023a1cd37-secret-metrics-server-client-certs\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.201225 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.201069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a4ef38e-4c51-45f7-8be5-355023a1cd37-client-ca-bundle\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.201225 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.201097    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4a4ef38e-4c51-45f7-8be5-355023a1cd37-audit-log\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.201427 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.201357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4a4ef38e-4c51-45f7-8be5-355023a1cd37-secret-metrics-server-tls\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.201478 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.201431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a4ef38e-4c51-45f7-8be5-355023a1cd37-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.201569 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.201546    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4a4ef38e-4c51-45f7-8be5-355023a1cd37-audit-log\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.202238 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.202159    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a4ef38e-4c51-45f7-8be5-355023a1cd37-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.202368 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.202329    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4a4ef38e-4c51-45f7-8be5-355023a1cd37-metrics-server-audit-profiles\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.204189 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.204143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4a4ef38e-4c51-45f7-8be5-355023a1cd37-secret-metrics-server-client-certs\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.204297 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.204221    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4a4ef38e-4c51-45f7-8be5-355023a1cd37-client-ca-bundle\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.204297 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.204262    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4a4ef38e-4c51-45f7-8be5-355023a1cd37-secret-metrics-server-tls\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.217457 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.217420    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m78d7\" (UniqueName: \"kubernetes.io/projected/4a4ef38e-4c51-45f7-8be5-355023a1cd37-kube-api-access-m78d7\") pod \"metrics-server-7456cb6c-fvlrl\" (UID: \"4a4ef38e-4c51-45f7-8be5-355023a1cd37\") " pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.315702 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.315642    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:03.380433 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.380343    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd"]
Jul 14 02:03:03.386965 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.386940    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd"
Jul 14 02:03:03.392723 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.390271    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 14 02:03:03.392723 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.390297    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qdn26\""
Jul 14 02:03:03.392723 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.392659    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd"]
Jul 14 02:03:03.442099 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.441339    2563 generic.go:356] "Generic (PLEG): container finished" podID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerID="63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca" exitCode=0
Jul 14 02:03:03.442099 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.441454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f752a1c-fce1-48df-91b8-b22c53a58040","Type":"ContainerDied","Data":"63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca"}
Jul 14 02:03:03.443517 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.443492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx" event={"ID":"342ddfbe-e3ea-4848-a01b-cfbc26140362","Type":"ContainerStarted","Data":"9a29426a24c841630371788e6f660e6c72b6d9ed5a8ff89d684d9b565968861f"}
Jul 14 02:03:03.487644 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.487590    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7456cb6c-fvlrl"]
Jul 14 02:03:03.491273 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:03:03.491242    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a4ef38e_4c51_45f7_8be5_355023a1cd37.slice/crio-557228f67588315fbe5c3efff9d34a2aaa50233cf8bc5f724c464f22d384196d WatchSource:0}: Error finding container 557228f67588315fbe5c3efff9d34a2aaa50233cf8bc5f724c464f22d384196d: Status 404 returned error can't find the container with id 557228f67588315fbe5c3efff9d34a2aaa50233cf8bc5f724c464f22d384196d
Jul 14 02:03:03.503803 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.503769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b8e2777-8105-44e4-b746-d8c53bc11efc-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-scqqd\" (UID: \"8b8e2777-8105-44e4-b746-d8c53bc11efc\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd"
Jul 14 02:03:03.504206 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.504000    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k7x8\" (UniqueName: \"kubernetes.io/projected/8b8e2777-8105-44e4-b746-d8c53bc11efc-kube-api-access-7k7x8\") pod \"monitoring-plugin-5f68df7f58-scqqd\" (UID: \"8b8e2777-8105-44e4-b746-d8c53bc11efc\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd"
Jul 14 02:03:03.605195 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.605131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b8e2777-8105-44e4-b746-d8c53bc11efc-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-scqqd\" (UID: \"8b8e2777-8105-44e4-b746-d8c53bc11efc\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd"
Jul 14 02:03:03.605391 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.605268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k7x8\" (UniqueName: \"kubernetes.io/projected/8b8e2777-8105-44e4-b746-d8c53bc11efc-kube-api-access-7k7x8\") pod \"monitoring-plugin-5f68df7f58-scqqd\" (UID: \"8b8e2777-8105-44e4-b746-d8c53bc11efc\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd"
Jul 14 02:03:03.605391 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:03:03.605307    2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 14 02:03:03.605499 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:03:03.605390    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b8e2777-8105-44e4-b746-d8c53bc11efc-monitoring-plugin-cert podName:8b8e2777-8105-44e4-b746-d8c53bc11efc nodeName:}" failed. No retries permitted until 2026-07-14 02:03:04.105366874 +0000 UTC m=+104.787942302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8b8e2777-8105-44e4-b746-d8c53bc11efc-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-scqqd" (UID: "8b8e2777-8105-44e4-b746-d8c53bc11efc") : secret "monitoring-plugin-cert" not found
Jul 14 02:03:03.617081 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:03.617050    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k7x8\" (UniqueName: \"kubernetes.io/projected/8b8e2777-8105-44e4-b746-d8c53bc11efc-kube-api-access-7k7x8\") pod \"monitoring-plugin-5f68df7f58-scqqd\" (UID: \"8b8e2777-8105-44e4-b746-d8c53bc11efc\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd"
Jul 14 02:03:04.108999 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:04.108960    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b8e2777-8105-44e4-b746-d8c53bc11efc-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-scqqd\" (UID: \"8b8e2777-8105-44e4-b746-d8c53bc11efc\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd"
Jul 14 02:03:04.111761 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:04.111734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8b8e2777-8105-44e4-b746-d8c53bc11efc-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-scqqd\" (UID: \"8b8e2777-8105-44e4-b746-d8c53bc11efc\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd"
Jul 14 02:03:04.304534 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:04.304493    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd"
Jul 14 02:03:04.450242 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:04.450137    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl" event={"ID":"4a4ef38e-4c51-45f7-8be5-355023a1cd37","Type":"ContainerStarted","Data":"557228f67588315fbe5c3efff9d34a2aaa50233cf8bc5f724c464f22d384196d"}
Jul 14 02:03:04.736717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:04.736634    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd"]
Jul 14 02:03:05.462182 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:05.462119    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd" event={"ID":"8b8e2777-8105-44e4-b746-d8c53bc11efc","Type":"ContainerStarted","Data":"55f304b830797ce1fe78694e37029f9825baccdebd568ea70aaf398b38c41e08"}
Jul 14 02:03:05.466100 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:05.465999    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx" event={"ID":"342ddfbe-e3ea-4848-a01b-cfbc26140362","Type":"ContainerStarted","Data":"a06958bef09e39dbca49ba057059db177b9e5fd3a4c9fec03e71087599e22d63"}
Jul 14 02:03:05.466299 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:05.466157    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx" event={"ID":"342ddfbe-e3ea-4848-a01b-cfbc26140362","Type":"ContainerStarted","Data":"dca0ad0df2a07924803ec0abd6b2913e25818a6d1c1e1feba05f099030005956"}
Jul 14 02:03:05.466299 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:05.466228    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx" event={"ID":"342ddfbe-e3ea-4848-a01b-cfbc26140362","Type":"ContainerStarted","Data":"99c04a965ce0a6b6b14edfb3ce49cb0765ccad20e999b2acbacb9a873a8abf93"}
Jul 14 02:03:07.478131 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.478089    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f752a1c-fce1-48df-91b8-b22c53a58040","Type":"ContainerStarted","Data":"ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850"}
Jul 14 02:03:07.478627 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.478204    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f752a1c-fce1-48df-91b8-b22c53a58040","Type":"ContainerStarted","Data":"1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea"}
Jul 14 02:03:07.478627 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.478249    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f752a1c-fce1-48df-91b8-b22c53a58040","Type":"ContainerStarted","Data":"aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4"}
Jul 14 02:03:07.478627 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.478287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f752a1c-fce1-48df-91b8-b22c53a58040","Type":"ContainerStarted","Data":"5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de"}
Jul 14 02:03:07.478627 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.478320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f752a1c-fce1-48df-91b8-b22c53a58040","Type":"ContainerStarted","Data":"0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304"}
Jul 14 02:03:07.478627 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.478355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f752a1c-fce1-48df-91b8-b22c53a58040","Type":"ContainerStarted","Data":"f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52"}
Jul 14 02:03:07.479676 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.479645    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl" event={"ID":"4a4ef38e-4c51-45f7-8be5-355023a1cd37","Type":"ContainerStarted","Data":"eda15308b71ff689c304dd31132c3a568ece15520a5793e957a18cb02ad1d0f3"}
Jul 14 02:03:07.482618 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.482587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx" event={"ID":"342ddfbe-e3ea-4848-a01b-cfbc26140362","Type":"ContainerStarted","Data":"0f062c4c0cd2c45c799418c4421a8616d7512bf5d806f38f7e00479c4fa16f55"}
Jul 14 02:03:07.482760 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.482649    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:07.482760 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.482681    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx" event={"ID":"342ddfbe-e3ea-4848-a01b-cfbc26140362","Type":"ContainerStarted","Data":"229a34f86ab2d33fd748f05993ceaa2394afe21cf0fd2e2a9ee7c6e6afa4e2ea"}
Jul 14 02:03:07.482760 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.482705    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx" event={"ID":"342ddfbe-e3ea-4848-a01b-cfbc26140362","Type":"ContainerStarted","Data":"7c0b0da5e48131345261a549547e12c5142032e09de631a66f961720634b0223"}
Jul 14 02:03:07.484113 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.484086    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd" event={"ID":"8b8e2777-8105-44e4-b746-d8c53bc11efc","Type":"ContainerStarted","Data":"7c5d0fdc934a62bcaba99b3244cc3b05327f56da9f6209b5c57c8770e263fef1"}
Jul 14 02:03:07.484321 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.484301    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd"
Jul 14 02:03:07.490398 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.490373    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd"
Jul 14 02:03:07.504618 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.504573    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.7005535419999998 podStartE2EDuration="8.504558054s" totalImagesPullingTime="4.78569969s" totalInitContainerRuntime="18.304822ms" isStatefulPod=false podCreationTimestamp="2026-07-14 02:02:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:03:07.503290312 +0000 UTC m=+108.185861170" watchObservedRunningTime="2026-07-14 02:03:07.504558054 +0000 UTC m=+108.187128893"
Jul 14 02:03:07.521667 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.521501    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl" podStartSLOduration=2.152949589 podStartE2EDuration="5.521477064s" totalImagesPullingTime="3.368527475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:03:07.519917968 +0000 UTC m=+108.202488824" watchObservedRunningTime="2026-07-14 02:03:07.521477064 +0000 UTC m=+108.204047900"
Jul 14 02:03:07.545610 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.545556    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-scqqd" podStartSLOduration=2.286439105 podStartE2EDuration="4.545541526s" totalImagesPullingTime="2.259102421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:03:07.544794886 +0000 UTC m=+108.227365749" watchObservedRunningTime="2026-07-14 02:03:07.545541526 +0000 UTC m=+108.228112363"
Jul 14 02:03:07.571022 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.570963    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx" podStartSLOduration=2.342425532 podStartE2EDuration="6.570942835s" totalImagesPullingTime="4.228517303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:03:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:03:07.568973031 +0000 UTC m=+108.251543891" watchObservedRunningTime="2026-07-14 02:03:07.570942835 +0000 UTC m=+108.253513671"
Jul 14 02:03:07.849736 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:07.849702    2563 scope.go:117] "RemoveContainer" containerID="6e36c6357302fa69a7c3ae079c1ba7c312b12ceb453231296c59e511ea8893ab"
Jul 14 02:03:08.491675 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:08.491641    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:03:08.492115 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:08.491775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-gwlst" event={"ID":"c77e9abc-8454-4bb3-a76e-44313a61006e","Type":"ContainerStarted","Data":"adbbcf6f9ad3fbe4215648f56acb132d36a8ca3c09bcc48566f6c2edbbd5d312"}
Jul 14 02:03:08.492877 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:08.492845    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:03:08.497403 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:08.497382    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-gwlst"
Jul 14 02:03:08.509646 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:08.509601    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-gwlst" podStartSLOduration=50.866469965 podStartE2EDuration="53.50958602s" totalImagesPullingTime="2.643116055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:03:08.508758928 +0000 UTC m=+109.191329765" watchObservedRunningTime="2026-07-14 02:03:08.50958602 +0000 UTC m=+109.192156884"
Jul 14 02:03:11.435883 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:11.435847    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qm78c"
Jul 14 02:03:13.497992 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:13.497959    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f95cccbb6-8gntx"
Jul 14 02:03:17.735095 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.735054    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7768867555-lvq2f"]
Jul 14 02:03:17.812066 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.812033    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7768867555-lvq2f"]
Jul 14 02:03:17.812290 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.812139    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:17.815096 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.815063    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 02:03:17.815316 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.815296    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-c6str\""
Jul 14 02:03:17.815411 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.815394    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 02:03:17.815489 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.815472    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 02:03:17.815587 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.815572    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 02:03:17.815657 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.815620    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 14 02:03:17.816531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.816511    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 14 02:03:17.816531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.816527    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 02:03:17.943222 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.943149    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40d6e2ac-28e6-4511-abf7-320df1881f43-console-serving-cert\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:17.943396 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.943285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40d6e2ac-28e6-4511-abf7-320df1881f43-console-oauth-config\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:17.943396 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.943375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-oauth-serving-cert\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:17.943475 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.943402    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-service-ca\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:17.943475 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.943424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gmsz\" (UniqueName: \"kubernetes.io/projected/40d6e2ac-28e6-4511-abf7-320df1881f43-kube-api-access-9gmsz\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:17.943537 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:17.943484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-console-config\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:18.044548 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:18.044454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gmsz\" (UniqueName: \"kubernetes.io/projected/40d6e2ac-28e6-4511-abf7-320df1881f43-kube-api-access-9gmsz\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:18.044548 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:18.044519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-console-config\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:18.044548 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:18.044542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40d6e2ac-28e6-4511-abf7-320df1881f43-console-serving-cert\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:18.044819 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:18.044581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40d6e2ac-28e6-4511-abf7-320df1881f43-console-oauth-config\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:18.044819 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:18.044617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-oauth-serving-cert\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:18.044819 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:18.044640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-service-ca\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:18.045374 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:18.045342    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-console-config\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:18.045504 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:18.045379    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-service-ca\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:18.045504 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:18.045453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-oauth-serving-cert\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:18.047145 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:18.047127    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40d6e2ac-28e6-4511-abf7-320df1881f43-console-oauth-config\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:18.047145 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:18.047135    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40d6e2ac-28e6-4511-abf7-320df1881f43-console-serving-cert\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:18.052303 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:18.052277    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gmsz\" (UniqueName: \"kubernetes.io/projected/40d6e2ac-28e6-4511-abf7-320df1881f43-kube-api-access-9gmsz\") pod \"console-7768867555-lvq2f\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") " pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:18.121940 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:18.121907    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:18.290613 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:18.290577    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7768867555-lvq2f"]
Jul 14 02:03:18.293425 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:03:18.293391    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d6e2ac_28e6_4511_abf7_320df1881f43.slice/crio-0e41bc5898f903b49262bfc9af834b972fe14f3f62e11fb09b874d17bc2a3dc7 WatchSource:0}: Error finding container 0e41bc5898f903b49262bfc9af834b972fe14f3f62e11fb09b874d17bc2a3dc7: Status 404 returned error can't find the container with id 0e41bc5898f903b49262bfc9af834b972fe14f3f62e11fb09b874d17bc2a3dc7
Jul 14 02:03:18.534546 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:18.534506    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7768867555-lvq2f" event={"ID":"40d6e2ac-28e6-4511-abf7-320df1881f43","Type":"ContainerStarted","Data":"0e41bc5898f903b49262bfc9af834b972fe14f3f62e11fb09b874d17bc2a3dc7"}
Jul 14 02:03:22.553805 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:22.553766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7768867555-lvq2f" event={"ID":"40d6e2ac-28e6-4511-abf7-320df1881f43","Type":"ContainerStarted","Data":"851af5b3a53b83a9359b00672727325df89534340b0b04901169b509ca9902e3"}
Jul 14 02:03:22.577508 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:22.577437    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7768867555-lvq2f" podStartSLOduration=1.98675543 podStartE2EDuration="5.577420012s" totalImagesPullingTime="3.590664582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:03:22.575923941 +0000 UTC m=+123.258494779" watchObservedRunningTime="2026-07-14 02:03:22.577420012 +0000 UTC m=+123.259990848"
Jul 14 02:03:22.805607 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:22.805531    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:03:23.316717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:23.316663    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:23.316909 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:23.316749    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:25.921944 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:25.921908    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd5566b87-k4s97"]
Jul 14 02:03:25.924292 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:25.924273    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:25.932293 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:25.932267    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 14 02:03:25.934965 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:25.934941    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd5566b87-k4s97"]
Jul 14 02:03:26.018843 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.018799    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-serving-cert\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.019037 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.018943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcpm5\" (UniqueName: \"kubernetes.io/projected/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-kube-api-access-kcpm5\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.019037 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.019021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-oauth-config\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.019151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.019039    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-service-ca\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.019151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.019062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-oauth-serving-cert\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.019151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.019135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-config\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.019487 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.019204    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-trusted-ca-bundle\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.120107 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.120053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-oauth-config\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.120107 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.120108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-service-ca\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.120374 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.120230    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-oauth-serving-cert\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.120374 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.120325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-config\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.120374 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.120356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-trusted-ca-bundle\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.120521 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.120429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-serving-cert\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.120521 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.120489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcpm5\" (UniqueName: \"kubernetes.io/projected/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-kube-api-access-kcpm5\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.121154 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.121125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-config\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.121154 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.121137    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-service-ca\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.121393 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.121135    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-oauth-serving-cert\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.121449 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.121393    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-trusted-ca-bundle\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.122846 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.122819    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-oauth-config\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.123004 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.122978    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-serving-cert\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.128645 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.128609    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcpm5\" (UniqueName: \"kubernetes.io/projected/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-kube-api-access-kcpm5\") pod \"console-7bd5566b87-k4s97\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") " pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.234940 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.234848    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:26.374072 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.372288    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd5566b87-k4s97"]
Jul 14 02:03:26.570734 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.570693    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd5566b87-k4s97" event={"ID":"59a663be-5b6f-4464-a8f8-6fba4ff63f8c","Type":"ContainerStarted","Data":"7cd276d151257171c6e96a7c9f31dfc13302895b5f2fe928f606c883b9863a8a"}
Jul 14 02:03:26.570932 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:26.570758    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd5566b87-k4s97" event={"ID":"59a663be-5b6f-4464-a8f8-6fba4ff63f8c","Type":"ContainerStarted","Data":"0e929c95c62542c0e0705f6ed98ef92935374a8ae898c29b69f93549322366f3"}
Jul 14 02:03:27.820014 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:27.819961    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57fb4955f-5m882" podUID="eca00a03-22f7-41d7-8633-f328a946aa58" containerName="registry" containerID="cri-o://e846636e51b3477f6418c2d616f7d73a3f2f2b14ae3525b46459c01265f002d2" gracePeriod=30
Jul 14 02:03:28.083366 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.083289    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:03:28.122560 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.122513    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:28.122735 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.122591    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:28.124811 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.124758    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bd5566b87-k4s97" podStartSLOduration=3.124739157 podStartE2EDuration="3.124739157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:03:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:03:26.587522974 +0000 UTC m=+127.270093831" watchObservedRunningTime="2026-07-14 02:03:28.124739157 +0000 UTC m=+128.807309994"
Jul 14 02:03:28.128345 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.128314    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:28.240018 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.239979    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eca00a03-22f7-41d7-8633-f328a946aa58-ca-trust-extracted\") pod \"eca00a03-22f7-41d7-8633-f328a946aa58\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") "
Jul 14 02:03:28.240229 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.240057    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eca00a03-22f7-41d7-8633-f328a946aa58-image-registry-private-configuration\") pod \"eca00a03-22f7-41d7-8633-f328a946aa58\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") "
Jul 14 02:03:28.240229 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.240087    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eca00a03-22f7-41d7-8633-f328a946aa58-installation-pull-secrets\") pod \"eca00a03-22f7-41d7-8633-f328a946aa58\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") "
Jul 14 02:03:28.240229 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.240128    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swhbw\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-kube-api-access-swhbw\") pod \"eca00a03-22f7-41d7-8633-f328a946aa58\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") "
Jul 14 02:03:28.240354 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.240304    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls\") pod \"eca00a03-22f7-41d7-8633-f328a946aa58\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") "
Jul 14 02:03:28.240432 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.240392    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eca00a03-22f7-41d7-8633-f328a946aa58-registry-certificates\") pod \"eca00a03-22f7-41d7-8633-f328a946aa58\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") "
Jul 14 02:03:28.240487 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.240435    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eca00a03-22f7-41d7-8633-f328a946aa58-trusted-ca\") pod \"eca00a03-22f7-41d7-8633-f328a946aa58\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") "
Jul 14 02:03:28.240487 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.240462    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-bound-sa-token\") pod \"eca00a03-22f7-41d7-8633-f328a946aa58\" (UID: \"eca00a03-22f7-41d7-8633-f328a946aa58\") "
Jul 14 02:03:28.241061 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.240810    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eca00a03-22f7-41d7-8633-f328a946aa58-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "eca00a03-22f7-41d7-8633-f328a946aa58" (UID: "eca00a03-22f7-41d7-8633-f328a946aa58"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:03:28.241061 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.240935    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eca00a03-22f7-41d7-8633-f328a946aa58-registry-certificates\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:03:28.241909 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.241864    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eca00a03-22f7-41d7-8633-f328a946aa58-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "eca00a03-22f7-41d7-8633-f328a946aa58" (UID: "eca00a03-22f7-41d7-8633-f328a946aa58"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:03:28.243060 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.243036    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "eca00a03-22f7-41d7-8633-f328a946aa58" (UID: "eca00a03-22f7-41d7-8633-f328a946aa58"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:03:28.243207 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.243185    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eca00a03-22f7-41d7-8633-f328a946aa58-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "eca00a03-22f7-41d7-8633-f328a946aa58" (UID: "eca00a03-22f7-41d7-8633-f328a946aa58"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:03:28.243272 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.243247    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-kube-api-access-swhbw" (OuterVolumeSpecName: "kube-api-access-swhbw") pod "eca00a03-22f7-41d7-8633-f328a946aa58" (UID: "eca00a03-22f7-41d7-8633-f328a946aa58"). InnerVolumeSpecName "kube-api-access-swhbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:03:28.243321 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.243247    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eca00a03-22f7-41d7-8633-f328a946aa58-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "eca00a03-22f7-41d7-8633-f328a946aa58" (UID: "eca00a03-22f7-41d7-8633-f328a946aa58"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:03:28.243656 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.243635    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "eca00a03-22f7-41d7-8633-f328a946aa58" (UID: "eca00a03-22f7-41d7-8633-f328a946aa58"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:03:28.249639 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.249614    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca00a03-22f7-41d7-8633-f328a946aa58-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "eca00a03-22f7-41d7-8633-f328a946aa58" (UID: "eca00a03-22f7-41d7-8633-f328a946aa58"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:03:28.342381 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.342289    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eca00a03-22f7-41d7-8633-f328a946aa58-trusted-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:03:28.342381 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.342323    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-bound-sa-token\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:03:28.342381 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.342334    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eca00a03-22f7-41d7-8633-f328a946aa58-ca-trust-extracted\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:03:28.342381 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.342346    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eca00a03-22f7-41d7-8633-f328a946aa58-image-registry-private-configuration\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:03:28.342381 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.342355    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eca00a03-22f7-41d7-8633-f328a946aa58-installation-pull-secrets\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:03:28.342381 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.342364    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swhbw\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-kube-api-access-swhbw\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:03:28.342381 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.342372    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eca00a03-22f7-41d7-8633-f328a946aa58-registry-tls\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:03:28.580757 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.580720    2563 generic.go:356] "Generic (PLEG): container finished" podID="eca00a03-22f7-41d7-8633-f328a946aa58" containerID="e846636e51b3477f6418c2d616f7d73a3f2f2b14ae3525b46459c01265f002d2" exitCode=0
Jul 14 02:03:28.580942 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.580773    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57fb4955f-5m882"
Jul 14 02:03:28.580942 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.580808    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57fb4955f-5m882" event={"ID":"eca00a03-22f7-41d7-8633-f328a946aa58","Type":"ContainerDied","Data":"e846636e51b3477f6418c2d616f7d73a3f2f2b14ae3525b46459c01265f002d2"}
Jul 14 02:03:28.580942 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.580863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57fb4955f-5m882" event={"ID":"eca00a03-22f7-41d7-8633-f328a946aa58","Type":"ContainerDied","Data":"9155ca261f6ffa9b03d7f8059ad30ec8699949dec7e7c4c2de4c4a6d3de16d7f"}
Jul 14 02:03:28.580942 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.580887    2563 scope.go:117] "RemoveContainer" containerID="e846636e51b3477f6418c2d616f7d73a3f2f2b14ae3525b46459c01265f002d2"
Jul 14 02:03:28.585556 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.585528    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:03:28.590679 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.590661    2563 scope.go:117] "RemoveContainer" containerID="e846636e51b3477f6418c2d616f7d73a3f2f2b14ae3525b46459c01265f002d2"
Jul 14 02:03:28.590986 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:03:28.590965    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e846636e51b3477f6418c2d616f7d73a3f2f2b14ae3525b46459c01265f002d2\": container with ID starting with e846636e51b3477f6418c2d616f7d73a3f2f2b14ae3525b46459c01265f002d2 not found: ID does not exist" containerID="e846636e51b3477f6418c2d616f7d73a3f2f2b14ae3525b46459c01265f002d2"
Jul 14 02:03:28.591028 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.590998    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e846636e51b3477f6418c2d616f7d73a3f2f2b14ae3525b46459c01265f002d2"} err="failed to get container status \"e846636e51b3477f6418c2d616f7d73a3f2f2b14ae3525b46459c01265f002d2\": rpc error: code = NotFound desc = could not find container \"e846636e51b3477f6418c2d616f7d73a3f2f2b14ae3525b46459c01265f002d2\": container with ID starting with e846636e51b3477f6418c2d616f7d73a3f2f2b14ae3525b46459c01265f002d2 not found: ID does not exist"
Jul 14 02:03:28.616760 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.616658    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57fb4955f-5m882"]
Jul 14 02:03:28.622389 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:28.622354    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57fb4955f-5m882"]
Jul 14 02:03:29.586074 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:29.586042    2563 generic.go:356] "Generic (PLEG): container finished" podID="6d7e99e2-72d9-4f00-9757-52076bf47f6b" containerID="e69c018b70bed92f32d46ef9b063584b3daeee8d820cd61d39585e9d25a1d5de" exitCode=0
Jul 14 02:03:29.586522 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:29.586113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8" event={"ID":"6d7e99e2-72d9-4f00-9757-52076bf47f6b","Type":"ContainerDied","Data":"e69c018b70bed92f32d46ef9b063584b3daeee8d820cd61d39585e9d25a1d5de"}
Jul 14 02:03:29.586522 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:29.586511    2563 scope.go:117] "RemoveContainer" containerID="e69c018b70bed92f32d46ef9b063584b3daeee8d820cd61d39585e9d25a1d5de"
Jul 14 02:03:29.655982 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:29.655939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs\") pod \"network-metrics-daemon-wnrxm\" (UID: \"cf6bc5ea-e0e1-415d-b47a-19bc897a699c\") " pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:03:29.658377 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:29.658345    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf6bc5ea-e0e1-415d-b47a-19bc897a699c-metrics-certs\") pod \"network-metrics-daemon-wnrxm\" (UID: \"cf6bc5ea-e0e1-415d-b47a-19bc897a699c\") " pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:03:29.763326 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:29.763291    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-klxhd\""
Jul 14 02:03:29.771549 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:29.771515    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnrxm"
Jul 14 02:03:29.861448 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:29.861355    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eca00a03-22f7-41d7-8633-f328a946aa58" path="/var/lib/kubelet/pods/eca00a03-22f7-41d7-8633-f328a946aa58/volumes"
Jul 14 02:03:29.919242 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:29.919059    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wnrxm"]
Jul 14 02:03:29.921875 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:03:29.921832    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf6bc5ea_e0e1_415d_b47a_19bc897a699c.slice/crio-d2d29528e559af7cd24b2521fae9e9fac064d7afa07853452f5074e37b9cad61 WatchSource:0}: Error finding container d2d29528e559af7cd24b2521fae9e9fac064d7afa07853452f5074e37b9cad61: Status 404 returned error can't find the container with id d2d29528e559af7cd24b2521fae9e9fac064d7afa07853452f5074e37b9cad61
Jul 14 02:03:30.593518 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:30.593480    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sklw8" event={"ID":"6d7e99e2-72d9-4f00-9757-52076bf47f6b","Type":"ContainerStarted","Data":"c4317987933165001be048464c220e2d336db20e0f364acaff590610d546a71c"}
Jul 14 02:03:30.594823 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:30.594793    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wnrxm" event={"ID":"cf6bc5ea-e0e1-415d-b47a-19bc897a699c","Type":"ContainerStarted","Data":"d2d29528e559af7cd24b2521fae9e9fac064d7afa07853452f5074e37b9cad61"}
Jul 14 02:03:31.600860 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:31.600826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wnrxm" event={"ID":"cf6bc5ea-e0e1-415d-b47a-19bc897a699c","Type":"ContainerStarted","Data":"417b2f8f8e8578b2de75e489224c646dff461ba49afce77a7cff2e39520fd723"}
Jul 14 02:03:31.601295 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:31.600881    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wnrxm" event={"ID":"cf6bc5ea-e0e1-415d-b47a-19bc897a699c","Type":"ContainerStarted","Data":"23e88cf07dde0fbfb08c1be1407e9bd455dc00971d25d93e548689b7e0b54097"}
Jul 14 02:03:31.617561 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:31.617506    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wnrxm" podStartSLOduration=130.777615772 podStartE2EDuration="2m11.617489373s" totalImagesPullingTime="839.873601ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:03:31.616144605 +0000 UTC m=+132.298715463" watchObservedRunningTime="2026-07-14 02:03:31.617489373 +0000 UTC m=+132.300060209"
Jul 14 02:03:36.235904 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:36.235851    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:36.236488 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:36.235946    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:36.241790 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:36.241762    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:36.625792 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:36.625754    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:03:36.667969 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:36.667932    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7768867555-lvq2f"]
Jul 14 02:03:43.321507 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:43.321472    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:03:43.325422 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:03:43.325392    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7456cb6c-fvlrl"
Jul 14 02:04:01.695966 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:01.695921    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7768867555-lvq2f" podUID="40d6e2ac-28e6-4511-abf7-320df1881f43" containerName="console" containerID="cri-o://851af5b3a53b83a9359b00672727325df89534340b0b04901169b509ca9902e3" gracePeriod=15
Jul 14 02:04:01.955524 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:01.955453    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:04:02.052715 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.052678    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-console-config\") pod \"40d6e2ac-28e6-4511-abf7-320df1881f43\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") "
Jul 14 02:04:02.052715 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.052720    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40d6e2ac-28e6-4511-abf7-320df1881f43-console-serving-cert\") pod \"40d6e2ac-28e6-4511-abf7-320df1881f43\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") "
Jul 14 02:04:02.052973 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.052774    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-oauth-serving-cert\") pod \"40d6e2ac-28e6-4511-abf7-320df1881f43\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") "
Jul 14 02:04:02.052973 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.052793    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40d6e2ac-28e6-4511-abf7-320df1881f43-console-oauth-config\") pod \"40d6e2ac-28e6-4511-abf7-320df1881f43\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") "
Jul 14 02:04:02.052973 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.052828    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-service-ca\") pod \"40d6e2ac-28e6-4511-abf7-320df1881f43\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") "
Jul 14 02:04:02.052973 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.052888    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gmsz\" (UniqueName: \"kubernetes.io/projected/40d6e2ac-28e6-4511-abf7-320df1881f43-kube-api-access-9gmsz\") pod \"40d6e2ac-28e6-4511-abf7-320df1881f43\" (UID: \"40d6e2ac-28e6-4511-abf7-320df1881f43\") "
Jul 14 02:04:02.053266 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.053227    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "40d6e2ac-28e6-4511-abf7-320df1881f43" (UID: "40d6e2ac-28e6-4511-abf7-320df1881f43"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:04:02.053266 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.053243    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-console-config" (OuterVolumeSpecName: "console-config") pod "40d6e2ac-28e6-4511-abf7-320df1881f43" (UID: "40d6e2ac-28e6-4511-abf7-320df1881f43"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:04:02.053420 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.053332    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-service-ca" (OuterVolumeSpecName: "service-ca") pod "40d6e2ac-28e6-4511-abf7-320df1881f43" (UID: "40d6e2ac-28e6-4511-abf7-320df1881f43"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:04:02.055158 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.055122    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40d6e2ac-28e6-4511-abf7-320df1881f43-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "40d6e2ac-28e6-4511-abf7-320df1881f43" (UID: "40d6e2ac-28e6-4511-abf7-320df1881f43"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:04:02.055270 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.055187    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40d6e2ac-28e6-4511-abf7-320df1881f43-kube-api-access-9gmsz" (OuterVolumeSpecName: "kube-api-access-9gmsz") pod "40d6e2ac-28e6-4511-abf7-320df1881f43" (UID: "40d6e2ac-28e6-4511-abf7-320df1881f43"). InnerVolumeSpecName "kube-api-access-9gmsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:04:02.055309 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.055275    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40d6e2ac-28e6-4511-abf7-320df1881f43-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "40d6e2ac-28e6-4511-abf7-320df1881f43" (UID: "40d6e2ac-28e6-4511-abf7-320df1881f43"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:04:02.153557 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.153517    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-oauth-serving-cert\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:02.153557 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.153549    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40d6e2ac-28e6-4511-abf7-320df1881f43-console-oauth-config\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:02.153557 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.153560    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:02.153788 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.153571    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gmsz\" (UniqueName: \"kubernetes.io/projected/40d6e2ac-28e6-4511-abf7-320df1881f43-kube-api-access-9gmsz\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:02.153788 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.153580    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40d6e2ac-28e6-4511-abf7-320df1881f43-console-config\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:02.153788 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.153588    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40d6e2ac-28e6-4511-abf7-320df1881f43-console-serving-cert\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:02.731977 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.731937    2563 generic.go:356] "Generic (PLEG): container finished" podID="40d6e2ac-28e6-4511-abf7-320df1881f43" containerID="851af5b3a53b83a9359b00672727325df89534340b0b04901169b509ca9902e3" exitCode=0
Jul 14 02:04:02.732432 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.731987    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7768867555-lvq2f"
Jul 14 02:04:02.732432 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.732018    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7768867555-lvq2f" event={"ID":"40d6e2ac-28e6-4511-abf7-320df1881f43","Type":"ContainerDied","Data":"851af5b3a53b83a9359b00672727325df89534340b0b04901169b509ca9902e3"}
Jul 14 02:04:02.732432 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.732077    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7768867555-lvq2f" event={"ID":"40d6e2ac-28e6-4511-abf7-320df1881f43","Type":"ContainerDied","Data":"0e41bc5898f903b49262bfc9af834b972fe14f3f62e11fb09b874d17bc2a3dc7"}
Jul 14 02:04:02.732432 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.732099    2563 scope.go:117] "RemoveContainer" containerID="851af5b3a53b83a9359b00672727325df89534340b0b04901169b509ca9902e3"
Jul 14 02:04:02.744146 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.744125    2563 scope.go:117] "RemoveContainer" containerID="851af5b3a53b83a9359b00672727325df89534340b0b04901169b509ca9902e3"
Jul 14 02:04:02.744505 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:04:02.744480    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"851af5b3a53b83a9359b00672727325df89534340b0b04901169b509ca9902e3\": container with ID starting with 851af5b3a53b83a9359b00672727325df89534340b0b04901169b509ca9902e3 not found: ID does not exist" containerID="851af5b3a53b83a9359b00672727325df89534340b0b04901169b509ca9902e3"
Jul 14 02:04:02.744583 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.744517    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"851af5b3a53b83a9359b00672727325df89534340b0b04901169b509ca9902e3"} err="failed to get container status \"851af5b3a53b83a9359b00672727325df89534340b0b04901169b509ca9902e3\": rpc error: code = NotFound desc = could not find container \"851af5b3a53b83a9359b00672727325df89534340b0b04901169b509ca9902e3\": container with ID starting with 851af5b3a53b83a9359b00672727325df89534340b0b04901169b509ca9902e3 not found: ID does not exist"
Jul 14 02:04:02.754856 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.754826    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7768867555-lvq2f"]
Jul 14 02:04:02.756472 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:02.756444    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7768867555-lvq2f"]
Jul 14 02:04:03.854850 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:03.854813    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40d6e2ac-28e6-4511-abf7-320df1881f43" path="/var/lib/kubelet/pods/40d6e2ac-28e6-4511-abf7-320df1881f43/volumes"
Jul 14 02:04:18.898238 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:18.898145    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 02:04:18.898761 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:18.898477    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="alertmanager" containerID="cri-o://f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52" gracePeriod=120
Jul 14 02:04:18.898761 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:18.898505    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="kube-rbac-proxy-web" containerID="cri-o://5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de" gracePeriod=120
Jul 14 02:04:18.898761 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:18.898520    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="prom-label-proxy" containerID="cri-o://ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850" gracePeriod=120
Jul 14 02:04:18.898761 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:18.898547    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="config-reloader" containerID="cri-o://0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304" gracePeriod=120
Jul 14 02:04:18.898761 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:18.898490    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="kube-rbac-proxy" containerID="cri-o://aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4" gracePeriod=120
Jul 14 02:04:18.898761 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:18.898706    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="kube-rbac-proxy-metric" containerID="cri-o://1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea" gracePeriod=120
Jul 14 02:04:19.809215 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:19.809161    2563 generic.go:356] "Generic (PLEG): container finished" podID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerID="ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850" exitCode=0
Jul 14 02:04:19.809215 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:19.809209    2563 generic.go:356] "Generic (PLEG): container finished" podID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerID="aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4" exitCode=0
Jul 14 02:04:19.809215 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:19.809205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f752a1c-fce1-48df-91b8-b22c53a58040","Type":"ContainerDied","Data":"ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850"}
Jul 14 02:04:19.809437 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:19.809277    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f752a1c-fce1-48df-91b8-b22c53a58040","Type":"ContainerDied","Data":"aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4"}
Jul 14 02:04:19.809437 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:19.809217    2563 generic.go:356] "Generic (PLEG): container finished" podID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerID="0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304" exitCode=0
Jul 14 02:04:19.809437 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:19.809299    2563 generic.go:356] "Generic (PLEG): container finished" podID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerID="f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52" exitCode=0
Jul 14 02:04:19.809437 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:19.809305    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f752a1c-fce1-48df-91b8-b22c53a58040","Type":"ContainerDied","Data":"0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304"}
Jul 14 02:04:19.809437 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:19.809330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f752a1c-fce1-48df-91b8-b22c53a58040","Type":"ContainerDied","Data":"f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52"}
Jul 14 02:04:20.140361 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.140333    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:20.215085 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.215040    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f752a1c-fce1-48df-91b8-b22c53a58040-config-out\") pod \"0f752a1c-fce1-48df-91b8-b22c53a58040\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") "
Jul 14 02:04:20.215085 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.215087    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0f752a1c-fce1-48df-91b8-b22c53a58040\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") "
Jul 14 02:04:20.215360 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.215116    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f752a1c-fce1-48df-91b8-b22c53a58040-tls-assets\") pod \"0f752a1c-fce1-48df-91b8-b22c53a58040\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") "
Jul 14 02:04:20.215360 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.215135    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f752a1c-fce1-48df-91b8-b22c53a58040-alertmanager-trusted-ca-bundle\") pod \"0f752a1c-fce1-48df-91b8-b22c53a58040\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") "
Jul 14 02:04:20.215457 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.215180    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy\") pod \"0f752a1c-fce1-48df-91b8-b22c53a58040\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") "
Jul 14 02:04:20.215516 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.215451    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-config-volume\") pod \"0f752a1c-fce1-48df-91b8-b22c53a58040\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") "
Jul 14 02:04:20.215516 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.215489    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-web-config\") pod \"0f752a1c-fce1-48df-91b8-b22c53a58040\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") "
Jul 14 02:04:20.215616 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.215516    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-cluster-tls-config\") pod \"0f752a1c-fce1-48df-91b8-b22c53a58040\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") "
Jul 14 02:04:20.215616 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.215552    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-main-tls\") pod \"0f752a1c-fce1-48df-91b8-b22c53a58040\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") "
Jul 14 02:04:20.215616 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.215575    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f752a1c-fce1-48df-91b8-b22c53a58040-metrics-client-ca\") pod \"0f752a1c-fce1-48df-91b8-b22c53a58040\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") "
Jul 14 02:04:20.215616 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.215607    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9qrn\" (UniqueName: \"kubernetes.io/projected/0f752a1c-fce1-48df-91b8-b22c53a58040-kube-api-access-h9qrn\") pod \"0f752a1c-fce1-48df-91b8-b22c53a58040\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") "
Jul 14 02:04:20.215805 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.215659    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy-web\") pod \"0f752a1c-fce1-48df-91b8-b22c53a58040\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") "
Jul 14 02:04:20.215805 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.215697    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f752a1c-fce1-48df-91b8-b22c53a58040-alertmanager-main-db\") pod \"0f752a1c-fce1-48df-91b8-b22c53a58040\" (UID: \"0f752a1c-fce1-48df-91b8-b22c53a58040\") "
Jul 14 02:04:20.216561 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.216119    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f752a1c-fce1-48df-91b8-b22c53a58040-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0f752a1c-fce1-48df-91b8-b22c53a58040" (UID: "0f752a1c-fce1-48df-91b8-b22c53a58040"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:04:20.216561 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.216346    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f752a1c-fce1-48df-91b8-b22c53a58040-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0f752a1c-fce1-48df-91b8-b22c53a58040" (UID: "0f752a1c-fce1-48df-91b8-b22c53a58040"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:04:20.216561 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.216521    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f752a1c-fce1-48df-91b8-b22c53a58040-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0f752a1c-fce1-48df-91b8-b22c53a58040" (UID: "0f752a1c-fce1-48df-91b8-b22c53a58040"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:04:20.218996 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.218967    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0f752a1c-fce1-48df-91b8-b22c53a58040" (UID: "0f752a1c-fce1-48df-91b8-b22c53a58040"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:04:20.219107 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.219012    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0f752a1c-fce1-48df-91b8-b22c53a58040" (UID: "0f752a1c-fce1-48df-91b8-b22c53a58040"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:04:20.219107 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.219078    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0f752a1c-fce1-48df-91b8-b22c53a58040" (UID: "0f752a1c-fce1-48df-91b8-b22c53a58040"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:04:20.219278 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.219195    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f752a1c-fce1-48df-91b8-b22c53a58040-config-out" (OuterVolumeSpecName: "config-out") pod "0f752a1c-fce1-48df-91b8-b22c53a58040" (UID: "0f752a1c-fce1-48df-91b8-b22c53a58040"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:04:20.219278 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.219259    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f752a1c-fce1-48df-91b8-b22c53a58040-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0f752a1c-fce1-48df-91b8-b22c53a58040" (UID: "0f752a1c-fce1-48df-91b8-b22c53a58040"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:04:20.219556 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.219522    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0f752a1c-fce1-48df-91b8-b22c53a58040" (UID: "0f752a1c-fce1-48df-91b8-b22c53a58040"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:04:20.219807 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.219780    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f752a1c-fce1-48df-91b8-b22c53a58040-kube-api-access-h9qrn" (OuterVolumeSpecName: "kube-api-access-h9qrn") pod "0f752a1c-fce1-48df-91b8-b22c53a58040" (UID: "0f752a1c-fce1-48df-91b8-b22c53a58040"). InnerVolumeSpecName "kube-api-access-h9qrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:04:20.219903 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.219820    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-config-volume" (OuterVolumeSpecName: "config-volume") pod "0f752a1c-fce1-48df-91b8-b22c53a58040" (UID: "0f752a1c-fce1-48df-91b8-b22c53a58040"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:04:20.223720 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.223696    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0f752a1c-fce1-48df-91b8-b22c53a58040" (UID: "0f752a1c-fce1-48df-91b8-b22c53a58040"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:04:20.231347 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.231316    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-web-config" (OuterVolumeSpecName: "web-config") pod "0f752a1c-fce1-48df-91b8-b22c53a58040" (UID: "0f752a1c-fce1-48df-91b8-b22c53a58040"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:04:20.316442 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.316408    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:20.316442 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.316442    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f752a1c-fce1-48df-91b8-b22c53a58040-alertmanager-main-db\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:20.316639 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.316455    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f752a1c-fce1-48df-91b8-b22c53a58040-config-out\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:20.316639 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.316464    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:20.316639 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.316473    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f752a1c-fce1-48df-91b8-b22c53a58040-tls-assets\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:20.316639 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.316482    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f752a1c-fce1-48df-91b8-b22c53a58040-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:20.316639 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.316490    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:20.316639 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.316499    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-config-volume\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:20.316639 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.316507    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-web-config\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:20.316639 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.316515    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-cluster-tls-config\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:20.316639 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.316522    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f752a1c-fce1-48df-91b8-b22c53a58040-secret-alertmanager-main-tls\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:20.316639 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.316533    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f752a1c-fce1-48df-91b8-b22c53a58040-metrics-client-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:20.316639 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.316541    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9qrn\" (UniqueName: \"kubernetes.io/projected/0f752a1c-fce1-48df-91b8-b22c53a58040-kube-api-access-h9qrn\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:04:20.816226 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.816190    2563 generic.go:356] "Generic (PLEG): container finished" podID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerID="1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea" exitCode=0
Jul 14 02:04:20.816226 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.816223    2563 generic.go:356] "Generic (PLEG): container finished" podID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerID="5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de" exitCode=0
Jul 14 02:04:20.816469 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.816273    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:20.816469 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.816279    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f752a1c-fce1-48df-91b8-b22c53a58040","Type":"ContainerDied","Data":"1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea"}
Jul 14 02:04:20.816469 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.816351    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f752a1c-fce1-48df-91b8-b22c53a58040","Type":"ContainerDied","Data":"5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de"}
Jul 14 02:04:20.816469 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.816381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f752a1c-fce1-48df-91b8-b22c53a58040","Type":"ContainerDied","Data":"bc03ed8eb5206038f8d90dcdf5a0902693a1911c7ec7bbb1209999189f3dad6b"}
Jul 14 02:04:20.816469 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.816421    2563 scope.go:117] "RemoveContainer" containerID="ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850"
Jul 14 02:04:20.825604 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.825531    2563 scope.go:117] "RemoveContainer" containerID="1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea"
Jul 14 02:04:20.835689 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.835666    2563 scope.go:117] "RemoveContainer" containerID="aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4"
Jul 14 02:04:20.843778 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.843752    2563 scope.go:117] "RemoveContainer" containerID="5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de"
Jul 14 02:04:20.846618 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.846595    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 02:04:20.850473 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.850445    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 02:04:20.852026 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.852009    2563 scope.go:117] "RemoveContainer" containerID="0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304"
Jul 14 02:04:20.859522 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.859501    2563 scope.go:117] "RemoveContainer" containerID="f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52"
Jul 14 02:04:20.867466 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.867439    2563 scope.go:117] "RemoveContainer" containerID="63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca"
Jul 14 02:04:20.875225 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.875200    2563 scope.go:117] "RemoveContainer" containerID="ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850"
Jul 14 02:04:20.875545 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:04:20.875522    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850\": container with ID starting with ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850 not found: ID does not exist" containerID="ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850"
Jul 14 02:04:20.875594 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.875556    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850"} err="failed to get container status \"ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850\": rpc error: code = NotFound desc = could not find container \"ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850\": container with ID starting with ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850 not found: ID does not exist"
Jul 14 02:04:20.875594 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.875577    2563 scope.go:117] "RemoveContainer" containerID="1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea"
Jul 14 02:04:20.875938 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:04:20.875911    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea\": container with ID starting with 1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea not found: ID does not exist" containerID="1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea"
Jul 14 02:04:20.876058 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.875945    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea"} err="failed to get container status \"1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea\": rpc error: code = NotFound desc = could not find container \"1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea\": container with ID starting with 1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea not found: ID does not exist"
Jul 14 02:04:20.876058 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.875969    2563 scope.go:117] "RemoveContainer" containerID="aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4"
Jul 14 02:04:20.876629 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:04:20.876339    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4\": container with ID starting with aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4 not found: ID does not exist" containerID="aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4"
Jul 14 02:04:20.876629 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.876370    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4"} err="failed to get container status \"aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4\": rpc error: code = NotFound desc = could not find container \"aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4\": container with ID starting with aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4 not found: ID does not exist"
Jul 14 02:04:20.876629 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.876389    2563 scope.go:117] "RemoveContainer" containerID="5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de"
Jul 14 02:04:20.877384 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:04:20.876727    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de\": container with ID starting with 5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de not found: ID does not exist" containerID="5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de"
Jul 14 02:04:20.877384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.876754    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de"} err="failed to get container status \"5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de\": rpc error: code = NotFound desc = could not find container \"5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de\": container with ID starting with 5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de not found: ID does not exist"
Jul 14 02:04:20.877384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.876773    2563 scope.go:117] "RemoveContainer" containerID="0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304"
Jul 14 02:04:20.877384 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:04:20.877038    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304\": container with ID starting with 0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304 not found: ID does not exist" containerID="0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304"
Jul 14 02:04:20.877384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.877067    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304"} err="failed to get container status \"0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304\": rpc error: code = NotFound desc = could not find container \"0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304\": container with ID starting with 0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304 not found: ID does not exist"
Jul 14 02:04:20.877384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.877083    2563 scope.go:117] "RemoveContainer" containerID="f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52"
Jul 14 02:04:20.877384 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:04:20.877307    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52\": container with ID starting with f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52 not found: ID does not exist" containerID="f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52"
Jul 14 02:04:20.877384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.877328    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52"} err="failed to get container status \"f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52\": rpc error: code = NotFound desc = could not find container \"f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52\": container with ID starting with f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52 not found: ID does not exist"
Jul 14 02:04:20.877384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.877353    2563 scope.go:117] "RemoveContainer" containerID="63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca"
Jul 14 02:04:20.877765 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:04:20.877609    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca\": container with ID starting with 63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca not found: ID does not exist" containerID="63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca"
Jul 14 02:04:20.877765 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.877629    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca"} err="failed to get container status \"63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca\": rpc error: code = NotFound desc = could not find container \"63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca\": container with ID starting with 63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca not found: ID does not exist"
Jul 14 02:04:20.877765 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.877642    2563 scope.go:117] "RemoveContainer" containerID="ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850"
Jul 14 02:04:20.877911 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.877892    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850"} err="failed to get container status \"ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850\": rpc error: code = NotFound desc = could not find container \"ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850\": container with ID starting with ab5568ef564c5a005112230be18038c609ee5c2a38a4aa62ff32afbb88789850 not found: ID does not exist"
Jul 14 02:04:20.877998 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.877911    2563 scope.go:117] "RemoveContainer" containerID="1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea"
Jul 14 02:04:20.878143 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.878121    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea"} err="failed to get container status \"1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea\": rpc error: code = NotFound desc = could not find container \"1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea\": container with ID starting with 1b327e79020a8302c9b02e099fe77425509f53327ef6b9cd9b8267eaccb473ea not found: ID does not exist"
Jul 14 02:04:20.878210 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.878144    2563 scope.go:117] "RemoveContainer" containerID="aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4"
Jul 14 02:04:20.878442 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.878419    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4"} err="failed to get container status \"aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4\": rpc error: code = NotFound desc = could not find container \"aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4\": container with ID starting with aa62a8f59eca40f6f415680645496da1986aced7c97938cbaeb1bf98190d09e4 not found: ID does not exist"
Jul 14 02:04:20.878486 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.878446    2563 scope.go:117] "RemoveContainer" containerID="5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de"
Jul 14 02:04:20.878563 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.878545    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 02:04:20.878736 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.878705    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de"} err="failed to get container status \"5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de\": rpc error: code = NotFound desc = could not find container \"5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de\": container with ID starting with 5ac8a98ffc90ff042d1c3541fc60d69f84f99ed0e6c50fa7e866ee1fcf5db8de not found: ID does not exist"
Jul 14 02:04:20.878789 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.878740    2563 scope.go:117] "RemoveContainer" containerID="0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304"
Jul 14 02:04:20.878972 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.878954    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="kube-rbac-proxy"
Jul 14 02:04:20.878972 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.878972    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="kube-rbac-proxy"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.878989    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="config-reloader"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.878995    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="config-reloader"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879005    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="prom-label-proxy"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879011    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="prom-label-proxy"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879020    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="alertmanager"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879026    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="alertmanager"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879030    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304"} err="failed to get container status \"0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304\": rpc error: code = NotFound desc = could not find container \"0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304\": container with ID starting with 0f92a6f39755be0f31720b5772c92a62c791d713681e83b979d099b9c5953304 not found: ID does not exist"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879043    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="kube-rbac-proxy-web"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879053    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="kube-rbac-proxy-web"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879056    2563 scope.go:117] "RemoveContainer" containerID="f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879060    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40d6e2ac-28e6-4511-abf7-320df1881f43" containerName="console"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879066    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="40d6e2ac-28e6-4511-abf7-320df1881f43" containerName="console"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879073    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eca00a03-22f7-41d7-8633-f328a946aa58" containerName="registry"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879078    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eca00a03-22f7-41d7-8633-f328a946aa58" containerName="registry"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879084    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="kube-rbac-proxy-metric"
Jul 14 02:04:20.879084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879090    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="kube-rbac-proxy-metric"
Jul 14 02:04:20.879812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879097    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="init-config-reloader"
Jul 14 02:04:20.879812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879104    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="init-config-reloader"
Jul 14 02:04:20.879812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879178    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="kube-rbac-proxy"
Jul 14 02:04:20.879812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879190    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="alertmanager"
Jul 14 02:04:20.879812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879200    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="config-reloader"
Jul 14 02:04:20.879812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879210    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="kube-rbac-proxy-web"
Jul 14 02:04:20.879812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879221    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="40d6e2ac-28e6-4511-abf7-320df1881f43" containerName="console"
Jul 14 02:04:20.879812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879229    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="eca00a03-22f7-41d7-8633-f328a946aa58" containerName="registry"
Jul 14 02:04:20.879812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879237    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="kube-rbac-proxy-metric"
Jul 14 02:04:20.879812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879243    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" containerName="prom-label-proxy"
Jul 14 02:04:20.879812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879267    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52"} err="failed to get container status \"f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52\": rpc error: code = NotFound desc = could not find container \"f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52\": container with ID starting with f3df15530c8b6189e32c06f165f0ddb8f60c153a38a38f540faa0078e9ef1a52 not found: ID does not exist"
Jul 14 02:04:20.879812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879284    2563 scope.go:117] "RemoveContainer" containerID="63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca"
Jul 14 02:04:20.879812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.879465    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca"} err="failed to get container status \"63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca\": rpc error: code = NotFound desc = could not find container \"63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca\": container with ID starting with 63f572c855fe6ae91ce2fbab359f578b45c27975e5fde3db353a2d5897c3ceca not found: ID does not exist"
Jul 14 02:04:20.884821 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.884796    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:20.887510 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.887483    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 14 02:04:20.887624 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.887493    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 14 02:04:20.887624 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.887494    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 14 02:04:20.887808 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.887794    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lgljr\""
Jul 14 02:04:20.887882 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.887865    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 14 02:04:20.887882 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.887876    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 14 02:04:20.887999 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.887907    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 14 02:04:20.887999 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.887907    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 14 02:04:20.887999 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.887876    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 14 02:04:20.892661 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.892637    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 14 02:04:20.897666 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.897644    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 02:04:20.920625 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.920573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:20.920625 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.920617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fdee9bc-1efb-4c08-9429-c50ce2c16222-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:20.921023 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.920670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fdee9bc-1efb-4c08-9429-c50ce2c16222-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:20.921023 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.920704    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:20.921023 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.920729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:20.921023 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.920763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fdee9bc-1efb-4c08-9429-c50ce2c16222-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:20.921023 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.920788    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-config-volume\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:20.921023 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.920847    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:20.921023 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.920882    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:20.921023 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.920921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fdee9bc-1efb-4c08-9429-c50ce2c16222-config-out\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:20.921023 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.920946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-web-config\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:20.921023 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.920986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fdee9bc-1efb-4c08-9429-c50ce2c16222-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:20.921023 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:20.921015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k7pl\" (UniqueName: \"kubernetes.io/projected/5fdee9bc-1efb-4c08-9429-c50ce2c16222-kube-api-access-6k7pl\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.022233 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.022159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fdee9bc-1efb-4c08-9429-c50ce2c16222-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.022416 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.022243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.022416 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.022263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.022416 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.022288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fdee9bc-1efb-4c08-9429-c50ce2c16222-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.022416 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.022314    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-config-volume\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.022416 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.022347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.022416 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.022376    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.022416 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.022415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fdee9bc-1efb-4c08-9429-c50ce2c16222-config-out\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.022760 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.022442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-web-config\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.022760 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.022464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fdee9bc-1efb-4c08-9429-c50ce2c16222-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.022760 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.022511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k7pl\" (UniqueName: \"kubernetes.io/projected/5fdee9bc-1efb-4c08-9429-c50ce2c16222-kube-api-access-6k7pl\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.022760 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.022545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.022760 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.022567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fdee9bc-1efb-4c08-9429-c50ce2c16222-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.023263 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.023235    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fdee9bc-1efb-4c08-9429-c50ce2c16222-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.023441 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.023253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fdee9bc-1efb-4c08-9429-c50ce2c16222-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.023796 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.023773    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fdee9bc-1efb-4c08-9429-c50ce2c16222-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.025724 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.025590    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.025724 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.025654    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fdee9bc-1efb-4c08-9429-c50ce2c16222-config-out\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.025724 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.025664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.025724 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.025699    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.025976 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.025739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-config-volume\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.025976 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.025806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fdee9bc-1efb-4c08-9429-c50ce2c16222-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.026270 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.026249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.026364 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.026348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-web-config\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.027566 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.027543    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fdee9bc-1efb-4c08-9429-c50ce2c16222-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.034562 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.034540    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k7pl\" (UniqueName: \"kubernetes.io/projected/5fdee9bc-1efb-4c08-9429-c50ce2c16222-kube-api-access-6k7pl\") pod \"alertmanager-main-0\" (UID: \"5fdee9bc-1efb-4c08-9429-c50ce2c16222\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.195056 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.194965    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 02:04:21.341652 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.341392    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 02:04:21.343822 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:04:21.343798    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fdee9bc_1efb_4c08_9429_c50ce2c16222.slice/crio-f925e66ef0bf164c8a0868559c6c7c7b8aba9a3369e2c9d15841350c2f3f1b76 WatchSource:0}: Error finding container f925e66ef0bf164c8a0868559c6c7c7b8aba9a3369e2c9d15841350c2f3f1b76: Status 404 returned error can't find the container with id f925e66ef0bf164c8a0868559c6c7c7b8aba9a3369e2c9d15841350c2f3f1b76
Jul 14 02:04:21.821741 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.821703    2563 generic.go:356] "Generic (PLEG): container finished" podID="5fdee9bc-1efb-4c08-9429-c50ce2c16222" containerID="5f6764537a658756f30b881931b498f15a88acb1d16d2594132601ae2b3d82c2" exitCode=0
Jul 14 02:04:21.821918 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.821791    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fdee9bc-1efb-4c08-9429-c50ce2c16222","Type":"ContainerDied","Data":"5f6764537a658756f30b881931b498f15a88acb1d16d2594132601ae2b3d82c2"}
Jul 14 02:04:21.821918 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.821868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fdee9bc-1efb-4c08-9429-c50ce2c16222","Type":"ContainerStarted","Data":"f925e66ef0bf164c8a0868559c6c7c7b8aba9a3369e2c9d15841350c2f3f1b76"}
Jul 14 02:04:21.855578 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:21.855547    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f752a1c-fce1-48df-91b8-b22c53a58040" path="/var/lib/kubelet/pods/0f752a1c-fce1-48df-91b8-b22c53a58040/volumes"
Jul 14 02:04:22.830844 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.830794    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fdee9bc-1efb-4c08-9429-c50ce2c16222","Type":"ContainerStarted","Data":"6d0ec82dd0a5b4f8c53e6177e7347a9db5c6894ccdf223e8e52b58edc1f7c48d"}
Jul 14 02:04:22.831306 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.830928    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fdee9bc-1efb-4c08-9429-c50ce2c16222","Type":"ContainerStarted","Data":"fadccd93a59dbc68bec0b0ced8706d9e2c2b14cc5566395ab0aff6e649124582"}
Jul 14 02:04:22.831306 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.830969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fdee9bc-1efb-4c08-9429-c50ce2c16222","Type":"ContainerStarted","Data":"ab70328e221a03437aaa28dec2b11de5e21c68627cae72a434bf1f5e33f3b474"}
Jul 14 02:04:22.831306 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.831011    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fdee9bc-1efb-4c08-9429-c50ce2c16222","Type":"ContainerStarted","Data":"765b404d512f2abf11871b2759768b5b10631081475e6a8a99fa08d3aaaf6857"}
Jul 14 02:04:22.831306 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.831046    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fdee9bc-1efb-4c08-9429-c50ce2c16222","Type":"ContainerStarted","Data":"a9fbbbd2c8ae7b7ab21d18f59a5320774170fb0d9884c27265ad7d44a994f945"}
Jul 14 02:04:22.831306 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.831080    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fdee9bc-1efb-4c08-9429-c50ce2c16222","Type":"ContainerStarted","Data":"51e2e92368149a212341aa6344eef45da40fb9de8cc3523688a264cff2b54355"}
Jul 14 02:04:22.885100 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.885033    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.867586128 podStartE2EDuration="2.885014603s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.428475ms" isStatefulPod=false podCreationTimestamp="2026-07-14 02:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:04:22.883160556 +0000 UTC m=+183.565731403" watchObservedRunningTime="2026-07-14 02:04:22.885014603 +0000 UTC m=+183.567585489"
Jul 14 02:04:22.984846 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.984803    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"]
Jul 14 02:04:22.988800 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.988775    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:22.991512 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.991475    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 14 02:04:22.991512 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.991484    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-z9mhl\""
Jul 14 02:04:22.991803 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.991784    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 14 02:04:22.991857 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.991799    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 14 02:04:22.991954 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.991938    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 14 02:04:22.992243 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.992221    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 14 02:04:22.998019 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:22.997996    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 14 02:04:23.002710 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.002687    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"]
Jul 14 02:04:23.042518 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.042476    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xflk9\" (UniqueName: \"kubernetes.io/projected/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-kube-api-access-xflk9\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.042720 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.042550    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-metrics-client-ca\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.042720 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.042595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-telemeter-client-tls\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.042720 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.042620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.042720 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.042651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.042720 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.042700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-federate-client-tls\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.042887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.042731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-secret-telemeter-client\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.042887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.042751    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-serving-certs-ca-bundle\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.144406 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.144290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-metrics-client-ca\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.144406 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.144356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-telemeter-client-tls\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.144406 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.144392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.144697 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.144426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.144697 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.144490    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-federate-client-tls\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.144697 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.144518    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-secret-telemeter-client\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.144697 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.144551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-serving-certs-ca-bundle\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.144697 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.144585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xflk9\" (UniqueName: \"kubernetes.io/projected/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-kube-api-access-xflk9\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.145551 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.145482    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-metrics-client-ca\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.145854 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.145827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.146082 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.146059    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-serving-certs-ca-bundle\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.148185 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.148055    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-secret-telemeter-client\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.148405 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.148380    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.148405 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.148401    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-federate-client-tls\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.148535 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.148434    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-telemeter-client-tls\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.154852 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.154823    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xflk9\" (UniqueName: \"kubernetes.io/projected/4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7-kube-api-access-xflk9\") pod \"telemeter-client-6fd4594bdf-5dhqs\" (UID: \"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7\") " pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.301258 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.301210    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"
Jul 14 02:04:23.469118 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.469089    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs"]
Jul 14 02:04:23.471477 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:04:23.471438    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f3ed24d_94f9_4fd5_9bc0_13a98d3e54a7.slice/crio-a5b799d111eee876c54429034f57206f03fe6133ec083e7a97f1b61413f4abe6 WatchSource:0}: Error finding container a5b799d111eee876c54429034f57206f03fe6133ec083e7a97f1b61413f4abe6: Status 404 returned error can't find the container with id a5b799d111eee876c54429034f57206f03fe6133ec083e7a97f1b61413f4abe6
Jul 14 02:04:23.836210 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:23.836148    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs" event={"ID":"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7","Type":"ContainerStarted","Data":"a5b799d111eee876c54429034f57206f03fe6133ec083e7a97f1b61413f4abe6"}
Jul 14 02:04:26.852674 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:26.852635    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs" event={"ID":"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7","Type":"ContainerStarted","Data":"575b721dbffea45f2daab142115861fd35ce66e1401c77a8379c3e2bc1820937"}
Jul 14 02:04:26.853149 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:26.852706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs" event={"ID":"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7","Type":"ContainerStarted","Data":"8518435f353fdd36f8c4f4a743057a67a9f47367c7775ada56c2e3290fa1e22d"}
Jul 14 02:04:26.853149 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:26.852731    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs" event={"ID":"4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7","Type":"ContainerStarted","Data":"5a3d4c85a6b5752764887f1b54863a933433709387ac63698d3d824867dae8e2"}
Jul 14 02:04:26.874667 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:26.874614    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6fd4594bdf-5dhqs" podStartSLOduration=2.556164438 podStartE2EDuration="4.874597781s" totalImagesPullingTime="2.318433343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:04:26.87448961 +0000 UTC m=+187.557060446" watchObservedRunningTime="2026-07-14 02:04:26.874597781 +0000 UTC m=+187.557168617"
Jul 14 02:04:27.945964 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:27.945919    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c8dbfb4cc-jv999"]
Jul 14 02:04:27.949955 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:27.949930    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:27.960144 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:27.960114    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8dbfb4cc-jv999"]
Jul 14 02:04:27.988963 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:27.988914    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdfn6\" (UniqueName: \"kubernetes.io/projected/cb0aed76-7315-47db-a954-9d5f73178fa5-kube-api-access-cdfn6\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:27.989137 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:27.989011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-service-ca\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:27.989137 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:27.989047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb0aed76-7315-47db-a954-9d5f73178fa5-console-oauth-config\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:27.989331 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:27.989221    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb0aed76-7315-47db-a954-9d5f73178fa5-console-serving-cert\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:27.989331 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:27.989255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-trusted-ca-bundle\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:27.989439 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:27.989326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-console-config\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:27.989439 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:27.989363    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-oauth-serving-cert\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.090233 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.090194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb0aed76-7315-47db-a954-9d5f73178fa5-console-serving-cert\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.090233 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.090233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-trusted-ca-bundle\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.090520 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.090255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-console-config\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.090520 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.090271    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-oauth-serving-cert\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.090520 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.090303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfn6\" (UniqueName: \"kubernetes.io/projected/cb0aed76-7315-47db-a954-9d5f73178fa5-kube-api-access-cdfn6\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.090520 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.090335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-service-ca\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.090520 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.090361    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb0aed76-7315-47db-a954-9d5f73178fa5-console-oauth-config\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.091092 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.091063    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-oauth-serving-cert\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.091301 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.091132    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-console-config\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.091301 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.091139    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-service-ca\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.091466 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.091273    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-trusted-ca-bundle\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.093090 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.093062    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb0aed76-7315-47db-a954-9d5f73178fa5-console-oauth-config\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.093243 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.093225    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb0aed76-7315-47db-a954-9d5f73178fa5-console-serving-cert\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.098662 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.098631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdfn6\" (UniqueName: \"kubernetes.io/projected/cb0aed76-7315-47db-a954-9d5f73178fa5-kube-api-access-cdfn6\") pod \"console-5c8dbfb4cc-jv999\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") " pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.261989 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.261890    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:28.407530 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.407505    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8dbfb4cc-jv999"]
Jul 14 02:04:28.409682 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:04:28.409649    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb0aed76_7315_47db_a954_9d5f73178fa5.slice/crio-d46a90ddf40f2dc007bd2197414507baaf2816ef33a643cfa9f54380f15428df WatchSource:0}: Error finding container d46a90ddf40f2dc007bd2197414507baaf2816ef33a643cfa9f54380f15428df: Status 404 returned error can't find the container with id d46a90ddf40f2dc007bd2197414507baaf2816ef33a643cfa9f54380f15428df
Jul 14 02:04:28.862751 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.862709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dbfb4cc-jv999" event={"ID":"cb0aed76-7315-47db-a954-9d5f73178fa5","Type":"ContainerStarted","Data":"72f6cb0dd171750eedfb18c1efb263859555e9b5150b70226b9884b87b92878c"}
Jul 14 02:04:28.862972 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.862802    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dbfb4cc-jv999" event={"ID":"cb0aed76-7315-47db-a954-9d5f73178fa5","Type":"ContainerStarted","Data":"d46a90ddf40f2dc007bd2197414507baaf2816ef33a643cfa9f54380f15428df"}
Jul 14 02:04:28.880894 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:28.880837    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c8dbfb4cc-jv999" podStartSLOduration=1.880820137 podStartE2EDuration="1.880820137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:04:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:04:28.878871195 +0000 UTC m=+189.561442049" watchObservedRunningTime="2026-07-14 02:04:28.880820137 +0000 UTC m=+189.563390974"
Jul 14 02:04:38.262739 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:38.262694    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:38.263135 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:38.262804    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:38.267672 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:38.267637    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:38.910808 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:38.910777    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:04:38.957640 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:04:38.957604    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd5566b87-k4s97"]
Jul 14 02:05:03.979864 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:03.979812    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bd5566b87-k4s97" podUID="59a663be-5b6f-4464-a8f8-6fba4ff63f8c" containerName="console" containerID="cri-o://7cd276d151257171c6e96a7c9f31dfc13302895b5f2fe928f606c883b9863a8a" gracePeriod=15
Jul 14 02:05:04.229531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.229504    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:05:04.413908 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.413860    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-config\") pod \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") "
Jul 14 02:05:04.413908 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.413915    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-service-ca\") pod \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") "
Jul 14 02:05:04.414213 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.413964    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-oauth-config\") pod \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") "
Jul 14 02:05:04.414213 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.413981    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-oauth-serving-cert\") pod \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") "
Jul 14 02:05:04.414213 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.414022    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-trusted-ca-bundle\") pod \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") "
Jul 14 02:05:04.414213 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.414053    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcpm5\" (UniqueName: \"kubernetes.io/projected/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-kube-api-access-kcpm5\") pod \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") "
Jul 14 02:05:04.414213 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.414080    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-serving-cert\") pod \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\" (UID: \"59a663be-5b6f-4464-a8f8-6fba4ff63f8c\") "
Jul 14 02:05:04.414490 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.414456    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-config" (OuterVolumeSpecName: "console-config") pod "59a663be-5b6f-4464-a8f8-6fba4ff63f8c" (UID: "59a663be-5b6f-4464-a8f8-6fba4ff63f8c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:05:04.414552 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.414465    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-service-ca" (OuterVolumeSpecName: "service-ca") pod "59a663be-5b6f-4464-a8f8-6fba4ff63f8c" (UID: "59a663be-5b6f-4464-a8f8-6fba4ff63f8c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:05:04.414629 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.414592    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "59a663be-5b6f-4464-a8f8-6fba4ff63f8c" (UID: "59a663be-5b6f-4464-a8f8-6fba4ff63f8c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:05:04.414798 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.414778    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "59a663be-5b6f-4464-a8f8-6fba4ff63f8c" (UID: "59a663be-5b6f-4464-a8f8-6fba4ff63f8c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:05:04.416384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.416346    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "59a663be-5b6f-4464-a8f8-6fba4ff63f8c" (UID: "59a663be-5b6f-4464-a8f8-6fba4ff63f8c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:05:04.416384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.416357    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "59a663be-5b6f-4464-a8f8-6fba4ff63f8c" (UID: "59a663be-5b6f-4464-a8f8-6fba4ff63f8c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:05:04.416518 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.416377    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-kube-api-access-kcpm5" (OuterVolumeSpecName: "kube-api-access-kcpm5") pod "59a663be-5b6f-4464-a8f8-6fba4ff63f8c" (UID: "59a663be-5b6f-4464-a8f8-6fba4ff63f8c"). InnerVolumeSpecName "kube-api-access-kcpm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:05:04.515068 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.515032    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-config\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:05:04.515068 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.515064    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:05:04.515068 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.515073    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-oauth-config\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:05:04.515351 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.515083    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-oauth-serving-cert\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:05:04.515351 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.515091    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-trusted-ca-bundle\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:05:04.515351 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.515101    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcpm5\" (UniqueName: \"kubernetes.io/projected/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-kube-api-access-kcpm5\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:05:04.515351 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:04.515111    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59a663be-5b6f-4464-a8f8-6fba4ff63f8c-console-serving-cert\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:05:05.032162 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:05.032130    2563 generic.go:356] "Generic (PLEG): container finished" podID="59a663be-5b6f-4464-a8f8-6fba4ff63f8c" containerID="7cd276d151257171c6e96a7c9f31dfc13302895b5f2fe928f606c883b9863a8a" exitCode=0
Jul 14 02:05:05.032585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:05.032189    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd5566b87-k4s97"
Jul 14 02:05:05.032585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:05.032211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd5566b87-k4s97" event={"ID":"59a663be-5b6f-4464-a8f8-6fba4ff63f8c","Type":"ContainerDied","Data":"7cd276d151257171c6e96a7c9f31dfc13302895b5f2fe928f606c883b9863a8a"}
Jul 14 02:05:05.032585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:05.032267    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd5566b87-k4s97" event={"ID":"59a663be-5b6f-4464-a8f8-6fba4ff63f8c","Type":"ContainerDied","Data":"0e929c95c62542c0e0705f6ed98ef92935374a8ae898c29b69f93549322366f3"}
Jul 14 02:05:05.032585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:05.032290    2563 scope.go:117] "RemoveContainer" containerID="7cd276d151257171c6e96a7c9f31dfc13302895b5f2fe928f606c883b9863a8a"
Jul 14 02:05:05.041544 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:05.041524    2563 scope.go:117] "RemoveContainer" containerID="7cd276d151257171c6e96a7c9f31dfc13302895b5f2fe928f606c883b9863a8a"
Jul 14 02:05:05.041860 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:05:05.041825    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cd276d151257171c6e96a7c9f31dfc13302895b5f2fe928f606c883b9863a8a\": container with ID starting with 7cd276d151257171c6e96a7c9f31dfc13302895b5f2fe928f606c883b9863a8a not found: ID does not exist" containerID="7cd276d151257171c6e96a7c9f31dfc13302895b5f2fe928f606c883b9863a8a"
Jul 14 02:05:05.041912 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:05.041867    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cd276d151257171c6e96a7c9f31dfc13302895b5f2fe928f606c883b9863a8a"} err="failed to get container status \"7cd276d151257171c6e96a7c9f31dfc13302895b5f2fe928f606c883b9863a8a\": rpc error: code = NotFound desc = could not find container \"7cd276d151257171c6e96a7c9f31dfc13302895b5f2fe928f606c883b9863a8a\": container with ID starting with 7cd276d151257171c6e96a7c9f31dfc13302895b5f2fe928f606c883b9863a8a not found: ID does not exist"
Jul 14 02:05:05.052864 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:05.052822    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd5566b87-k4s97"]
Jul 14 02:05:05.056647 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:05.056616    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bd5566b87-k4s97"]
Jul 14 02:05:05.855062 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:05:05.855030    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59a663be-5b6f-4464-a8f8-6fba4ff63f8c" path="/var/lib/kubelet/pods/59a663be-5b6f-4464-a8f8-6fba4ff63f8c/volumes"
Jul 14 02:06:08.630645 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.630603    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fdbdc75d8-42j2f"]
Jul 14 02:06:08.631221 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.631003    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59a663be-5b6f-4464-a8f8-6fba4ff63f8c" containerName="console"
Jul 14 02:06:08.631221 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.631022    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="59a663be-5b6f-4464-a8f8-6fba4ff63f8c" containerName="console"
Jul 14 02:06:08.631221 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.631100    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="59a663be-5b6f-4464-a8f8-6fba4ff63f8c" containerName="console"
Jul 14 02:06:08.634231 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.634207    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.644765 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.644732    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fdbdc75d8-42j2f"]
Jul 14 02:06:08.660160 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.660105    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-trusted-ca-bundle\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.660367 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.660187    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfpsd\" (UniqueName: \"kubernetes.io/projected/a2d6c3ef-9708-4791-b265-b894afd8a851-kube-api-access-hfpsd\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.660367 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.660279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-console-config\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.660367 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.660318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-service-ca\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.660516 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.660371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2d6c3ef-9708-4791-b265-b894afd8a851-console-serving-cert\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.660516 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.660426    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-oauth-serving-cert\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.660516 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.660502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2d6c3ef-9708-4791-b265-b894afd8a851-console-oauth-config\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.760976 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.760925    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2d6c3ef-9708-4791-b265-b894afd8a851-console-serving-cert\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.761240 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.760999    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-oauth-serving-cert\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.761240 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.761041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2d6c3ef-9708-4791-b265-b894afd8a851-console-oauth-config\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.761240 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.761080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-trusted-ca-bundle\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.761240 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.761228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfpsd\" (UniqueName: \"kubernetes.io/projected/a2d6c3ef-9708-4791-b265-b894afd8a851-kube-api-access-hfpsd\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.761477 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.761288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-console-config\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.761477 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.761325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-service-ca\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.761943 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.761914    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-oauth-serving-cert\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.762045 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.762018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-trusted-ca-bundle\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.762098 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.762019    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-console-config\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.762156 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.762134    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-service-ca\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.763636 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.763616    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2d6c3ef-9708-4791-b265-b894afd8a851-console-serving-cert\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.763721 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.763632    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2d6c3ef-9708-4791-b265-b894afd8a851-console-oauth-config\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.768526 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.768508    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfpsd\" (UniqueName: \"kubernetes.io/projected/a2d6c3ef-9708-4791-b265-b894afd8a851-kube-api-access-hfpsd\") pod \"console-6fdbdc75d8-42j2f\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") " pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:08.944291 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:08.944192    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:09.085860 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:09.085832    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fdbdc75d8-42j2f"]
Jul 14 02:06:09.088660 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:06:09.088630    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2d6c3ef_9708_4791_b265_b894afd8a851.slice/crio-f6f95854d7bbbb2126260b6535192a64387da8a3b1a2eb7ab1d59309073e61bf WatchSource:0}: Error finding container f6f95854d7bbbb2126260b6535192a64387da8a3b1a2eb7ab1d59309073e61bf: Status 404 returned error can't find the container with id f6f95854d7bbbb2126260b6535192a64387da8a3b1a2eb7ab1d59309073e61bf
Jul 14 02:06:09.303558 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:09.303473    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdbdc75d8-42j2f" event={"ID":"a2d6c3ef-9708-4791-b265-b894afd8a851","Type":"ContainerStarted","Data":"855e97d90d08fb62858a673c9c4845378cb80fd6fdf61aeb62ee09b6eb07dfec"}
Jul 14 02:06:09.303558 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:09.303529    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdbdc75d8-42j2f" event={"ID":"a2d6c3ef-9708-4791-b265-b894afd8a851","Type":"ContainerStarted","Data":"f6f95854d7bbbb2126260b6535192a64387da8a3b1a2eb7ab1d59309073e61bf"}
Jul 14 02:06:09.320776 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:09.320714    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fdbdc75d8-42j2f" podStartSLOduration=1.320695877 podStartE2EDuration="1.320695877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:06:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:06:09.319846706 +0000 UTC m=+290.002417563" watchObservedRunningTime="2026-07-14 02:06:09.320695877 +0000 UTC m=+290.003266797"
Jul 14 02:06:18.944396 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:18.944348    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:18.944803 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:18.944419    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:18.949257 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:18.949225    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:19.350576 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:19.350542    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:06:19.400103 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:19.400064    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8dbfb4cc-jv999"]
Jul 14 02:06:19.755336 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:19.755254    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:06:19.756274 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:19.756242    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:06:19.759466 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:19.759439    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:06:19.760314 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:19.760295    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:06:19.765431 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:19.765408    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 02:06:30.279283 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.279245    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"]
Jul 14 02:06:30.282630 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.282610    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"
Jul 14 02:06:30.285267 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.285240    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 14 02:06:30.285388 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.285307    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 14 02:06:30.285388 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.285251    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rjwcs\""
Jul 14 02:06:30.291352 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.291329    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"]
Jul 14 02:06:30.347565 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.347522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11251d02-5e6d-4681-8174-45cecf122b01-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8\" (UID: \"11251d02-5e6d-4681-8174-45cecf122b01\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"
Jul 14 02:06:30.347745 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.347607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11251d02-5e6d-4681-8174-45cecf122b01-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8\" (UID: \"11251d02-5e6d-4681-8174-45cecf122b01\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"
Jul 14 02:06:30.347745 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.347674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4sn7\" (UniqueName: \"kubernetes.io/projected/11251d02-5e6d-4681-8174-45cecf122b01-kube-api-access-v4sn7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8\" (UID: \"11251d02-5e6d-4681-8174-45cecf122b01\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"
Jul 14 02:06:30.448902 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.448859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11251d02-5e6d-4681-8174-45cecf122b01-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8\" (UID: \"11251d02-5e6d-4681-8174-45cecf122b01\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"
Jul 14 02:06:30.449122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.448958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11251d02-5e6d-4681-8174-45cecf122b01-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8\" (UID: \"11251d02-5e6d-4681-8174-45cecf122b01\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"
Jul 14 02:06:30.449122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.449001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4sn7\" (UniqueName: \"kubernetes.io/projected/11251d02-5e6d-4681-8174-45cecf122b01-kube-api-access-v4sn7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8\" (UID: \"11251d02-5e6d-4681-8174-45cecf122b01\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"
Jul 14 02:06:30.449400 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.449376    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11251d02-5e6d-4681-8174-45cecf122b01-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8\" (UID: \"11251d02-5e6d-4681-8174-45cecf122b01\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"
Jul 14 02:06:30.449472 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.449379    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11251d02-5e6d-4681-8174-45cecf122b01-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8\" (UID: \"11251d02-5e6d-4681-8174-45cecf122b01\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"
Jul 14 02:06:30.457601 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.457576    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4sn7\" (UniqueName: \"kubernetes.io/projected/11251d02-5e6d-4681-8174-45cecf122b01-kube-api-access-v4sn7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8\" (UID: \"11251d02-5e6d-4681-8174-45cecf122b01\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"
Jul 14 02:06:30.592573 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.592542    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"
Jul 14 02:06:30.732434 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.732287    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"]
Jul 14 02:06:30.734802 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:06:30.734762    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11251d02_5e6d_4681_8174_45cecf122b01.slice/crio-3a245e65e7bbd3a51844db98a661e8e9e2cb0d96aaf178359a792b898cb19165 WatchSource:0}: Error finding container 3a245e65e7bbd3a51844db98a661e8e9e2cb0d96aaf178359a792b898cb19165: Status 404 returned error can't find the container with id 3a245e65e7bbd3a51844db98a661e8e9e2cb0d96aaf178359a792b898cb19165
Jul 14 02:06:30.736614 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:30.736592    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 02:06:31.396378 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:31.396345    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8" event={"ID":"11251d02-5e6d-4681-8174-45cecf122b01","Type":"ContainerStarted","Data":"3a245e65e7bbd3a51844db98a661e8e9e2cb0d96aaf178359a792b898cb19165"}
Jul 14 02:06:39.436114 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:39.436078    2563 generic.go:356] "Generic (PLEG): container finished" podID="11251d02-5e6d-4681-8174-45cecf122b01" containerID="dc05781192eab4503d42acd0b654c7ae87f34d6617f09809203d23a2dbc774fa" exitCode=0
Jul 14 02:06:39.436623 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:39.436202    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8" event={"ID":"11251d02-5e6d-4681-8174-45cecf122b01","Type":"ContainerDied","Data":"dc05781192eab4503d42acd0b654c7ae87f34d6617f09809203d23a2dbc774fa"}
Jul 14 02:06:42.456563 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:42.456526    2563 generic.go:356] "Generic (PLEG): container finished" podID="11251d02-5e6d-4681-8174-45cecf122b01" containerID="84a64be4b118096de61dec746350aab5acb22f3dc2b3b33abcbc8a7f6d2f1695" exitCode=0
Jul 14 02:06:42.457019 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:42.456604    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8" event={"ID":"11251d02-5e6d-4681-8174-45cecf122b01","Type":"ContainerDied","Data":"84a64be4b118096de61dec746350aab5acb22f3dc2b3b33abcbc8a7f6d2f1695"}
Jul 14 02:06:44.422125 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.422083    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c8dbfb4cc-jv999" podUID="cb0aed76-7315-47db-a954-9d5f73178fa5" containerName="console" containerID="cri-o://72f6cb0dd171750eedfb18c1efb263859555e9b5150b70226b9884b87b92878c" gracePeriod=15
Jul 14 02:06:44.692875 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.692848    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:06:44.789979 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.789945    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-service-ca\") pod \"cb0aed76-7315-47db-a954-9d5f73178fa5\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") "
Jul 14 02:06:44.789979 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.789987    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-oauth-serving-cert\") pod \"cb0aed76-7315-47db-a954-9d5f73178fa5\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") "
Jul 14 02:06:44.790239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.790014    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-trusted-ca-bundle\") pod \"cb0aed76-7315-47db-a954-9d5f73178fa5\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") "
Jul 14 02:06:44.790239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.790060    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb0aed76-7315-47db-a954-9d5f73178fa5-console-oauth-config\") pod \"cb0aed76-7315-47db-a954-9d5f73178fa5\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") "
Jul 14 02:06:44.790239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.790088    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-console-config\") pod \"cb0aed76-7315-47db-a954-9d5f73178fa5\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") "
Jul 14 02:06:44.790239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.790120    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb0aed76-7315-47db-a954-9d5f73178fa5-console-serving-cert\") pod \"cb0aed76-7315-47db-a954-9d5f73178fa5\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") "
Jul 14 02:06:44.790239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.790143    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdfn6\" (UniqueName: \"kubernetes.io/projected/cb0aed76-7315-47db-a954-9d5f73178fa5-kube-api-access-cdfn6\") pod \"cb0aed76-7315-47db-a954-9d5f73178fa5\" (UID: \"cb0aed76-7315-47db-a954-9d5f73178fa5\") "
Jul 14 02:06:44.790463 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.790408    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cb0aed76-7315-47db-a954-9d5f73178fa5" (UID: "cb0aed76-7315-47db-a954-9d5f73178fa5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:06:44.790626 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.790589    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cb0aed76-7315-47db-a954-9d5f73178fa5" (UID: "cb0aed76-7315-47db-a954-9d5f73178fa5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:06:44.790747 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.790712    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-service-ca" (OuterVolumeSpecName: "service-ca") pod "cb0aed76-7315-47db-a954-9d5f73178fa5" (UID: "cb0aed76-7315-47db-a954-9d5f73178fa5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:06:44.790817 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.790754    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-console-config" (OuterVolumeSpecName: "console-config") pod "cb0aed76-7315-47db-a954-9d5f73178fa5" (UID: "cb0aed76-7315-47db-a954-9d5f73178fa5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:06:44.792395 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.792369    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb0aed76-7315-47db-a954-9d5f73178fa5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cb0aed76-7315-47db-a954-9d5f73178fa5" (UID: "cb0aed76-7315-47db-a954-9d5f73178fa5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:06:44.792481 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.792412    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb0aed76-7315-47db-a954-9d5f73178fa5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cb0aed76-7315-47db-a954-9d5f73178fa5" (UID: "cb0aed76-7315-47db-a954-9d5f73178fa5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:06:44.792520 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.792473    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb0aed76-7315-47db-a954-9d5f73178fa5-kube-api-access-cdfn6" (OuterVolumeSpecName: "kube-api-access-cdfn6") pod "cb0aed76-7315-47db-a954-9d5f73178fa5" (UID: "cb0aed76-7315-47db-a954-9d5f73178fa5"). InnerVolumeSpecName "kube-api-access-cdfn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:06:44.890932 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.890899    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cb0aed76-7315-47db-a954-9d5f73178fa5-console-oauth-config\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:06:44.890932 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.890931    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-console-config\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:06:44.891149 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.890943    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cb0aed76-7315-47db-a954-9d5f73178fa5-console-serving-cert\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:06:44.891149 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.890953    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdfn6\" (UniqueName: \"kubernetes.io/projected/cb0aed76-7315-47db-a954-9d5f73178fa5-kube-api-access-cdfn6\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:06:44.891149 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.890964    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:06:44.891149 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.890972    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-oauth-serving-cert\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:06:44.891149 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:44.890980    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb0aed76-7315-47db-a954-9d5f73178fa5-trusted-ca-bundle\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:06:45.473024 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:45.472987    2563 generic.go:356] "Generic (PLEG): container finished" podID="cb0aed76-7315-47db-a954-9d5f73178fa5" containerID="72f6cb0dd171750eedfb18c1efb263859555e9b5150b70226b9884b87b92878c" exitCode=0
Jul 14 02:06:45.473459 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:45.473030    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dbfb4cc-jv999"
Jul 14 02:06:45.473459 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:45.473080    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dbfb4cc-jv999" event={"ID":"cb0aed76-7315-47db-a954-9d5f73178fa5","Type":"ContainerDied","Data":"72f6cb0dd171750eedfb18c1efb263859555e9b5150b70226b9884b87b92878c"}
Jul 14 02:06:45.473459 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:45.473129    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dbfb4cc-jv999" event={"ID":"cb0aed76-7315-47db-a954-9d5f73178fa5","Type":"ContainerDied","Data":"d46a90ddf40f2dc007bd2197414507baaf2816ef33a643cfa9f54380f15428df"}
Jul 14 02:06:45.473459 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:45.473151    2563 scope.go:117] "RemoveContainer" containerID="72f6cb0dd171750eedfb18c1efb263859555e9b5150b70226b9884b87b92878c"
Jul 14 02:06:45.482969 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:45.482951    2563 scope.go:117] "RemoveContainer" containerID="72f6cb0dd171750eedfb18c1efb263859555e9b5150b70226b9884b87b92878c"
Jul 14 02:06:45.483311 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:06:45.483290    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72f6cb0dd171750eedfb18c1efb263859555e9b5150b70226b9884b87b92878c\": container with ID starting with 72f6cb0dd171750eedfb18c1efb263859555e9b5150b70226b9884b87b92878c not found: ID does not exist" containerID="72f6cb0dd171750eedfb18c1efb263859555e9b5150b70226b9884b87b92878c"
Jul 14 02:06:45.483361 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:45.483321    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72f6cb0dd171750eedfb18c1efb263859555e9b5150b70226b9884b87b92878c"} err="failed to get container status \"72f6cb0dd171750eedfb18c1efb263859555e9b5150b70226b9884b87b92878c\": rpc error: code = NotFound desc = could not find container \"72f6cb0dd171750eedfb18c1efb263859555e9b5150b70226b9884b87b92878c\": container with ID starting with 72f6cb0dd171750eedfb18c1efb263859555e9b5150b70226b9884b87b92878c not found: ID does not exist"
Jul 14 02:06:45.495031 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:45.494999    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8dbfb4cc-jv999"]
Jul 14 02:06:45.496515 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:45.496492    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c8dbfb4cc-jv999"]
Jul 14 02:06:45.855774 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:45.855737    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb0aed76-7315-47db-a954-9d5f73178fa5" path="/var/lib/kubelet/pods/cb0aed76-7315-47db-a954-9d5f73178fa5/volumes"
Jul 14 02:06:53.518685 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:53.518643    2563 generic.go:356] "Generic (PLEG): container finished" podID="11251d02-5e6d-4681-8174-45cecf122b01" containerID="f551a1efde4477ecac28fbfccbfaad70be215015102d3b0d58831d245b635fb7" exitCode=0
Jul 14 02:06:53.519090 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:53.518740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8" event={"ID":"11251d02-5e6d-4681-8174-45cecf122b01","Type":"ContainerDied","Data":"f551a1efde4477ecac28fbfccbfaad70be215015102d3b0d58831d245b635fb7"}
Jul 14 02:06:54.653187 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:54.653133    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"
Jul 14 02:06:54.676866 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:54.676829    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11251d02-5e6d-4681-8174-45cecf122b01-util\") pod \"11251d02-5e6d-4681-8174-45cecf122b01\" (UID: \"11251d02-5e6d-4681-8174-45cecf122b01\") "
Jul 14 02:06:54.677054 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:54.676883    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11251d02-5e6d-4681-8174-45cecf122b01-bundle\") pod \"11251d02-5e6d-4681-8174-45cecf122b01\" (UID: \"11251d02-5e6d-4681-8174-45cecf122b01\") "
Jul 14 02:06:54.677054 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:54.676946    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4sn7\" (UniqueName: \"kubernetes.io/projected/11251d02-5e6d-4681-8174-45cecf122b01-kube-api-access-v4sn7\") pod \"11251d02-5e6d-4681-8174-45cecf122b01\" (UID: \"11251d02-5e6d-4681-8174-45cecf122b01\") "
Jul 14 02:06:54.677553 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:54.677522    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11251d02-5e6d-4681-8174-45cecf122b01-bundle" (OuterVolumeSpecName: "bundle") pod "11251d02-5e6d-4681-8174-45cecf122b01" (UID: "11251d02-5e6d-4681-8174-45cecf122b01"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:06:54.679110 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:54.679085    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11251d02-5e6d-4681-8174-45cecf122b01-kube-api-access-v4sn7" (OuterVolumeSpecName: "kube-api-access-v4sn7") pod "11251d02-5e6d-4681-8174-45cecf122b01" (UID: "11251d02-5e6d-4681-8174-45cecf122b01"). InnerVolumeSpecName "kube-api-access-v4sn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:06:54.681394 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:54.681368    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11251d02-5e6d-4681-8174-45cecf122b01-util" (OuterVolumeSpecName: "util") pod "11251d02-5e6d-4681-8174-45cecf122b01" (UID: "11251d02-5e6d-4681-8174-45cecf122b01"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:06:54.777759 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:54.777657    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11251d02-5e6d-4681-8174-45cecf122b01-util\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:06:54.777759 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:54.777704    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11251d02-5e6d-4681-8174-45cecf122b01-bundle\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:06:54.777759 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:54.777717    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4sn7\" (UniqueName: \"kubernetes.io/projected/11251d02-5e6d-4681-8174-45cecf122b01-kube-api-access-v4sn7\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:06:55.529805 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:55.529769    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8"
Jul 14 02:06:55.529805 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:55.529793    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406dtt8" event={"ID":"11251d02-5e6d-4681-8174-45cecf122b01","Type":"ContainerDied","Data":"3a245e65e7bbd3a51844db98a661e8e9e2cb0d96aaf178359a792b898cb19165"}
Jul 14 02:06:55.530036 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:06:55.529887    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a245e65e7bbd3a51844db98a661e8e9e2cb0d96aaf178359a792b898cb19165"
Jul 14 02:07:07.332287 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.332248    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"]
Jul 14 02:07:07.332682 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.332624    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11251d02-5e6d-4681-8174-45cecf122b01" containerName="extract"
Jul 14 02:07:07.332682 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.332635    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="11251d02-5e6d-4681-8174-45cecf122b01" containerName="extract"
Jul 14 02:07:07.332682 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.332651    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb0aed76-7315-47db-a954-9d5f73178fa5" containerName="console"
Jul 14 02:07:07.332682 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.332657    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb0aed76-7315-47db-a954-9d5f73178fa5" containerName="console"
Jul 14 02:07:07.332682 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.332665    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11251d02-5e6d-4681-8174-45cecf122b01" containerName="util"
Jul 14 02:07:07.332682 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.332671    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="11251d02-5e6d-4681-8174-45cecf122b01" containerName="util"
Jul 14 02:07:07.332682 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.332677    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11251d02-5e6d-4681-8174-45cecf122b01" containerName="pull"
Jul 14 02:07:07.332682 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.332682    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="11251d02-5e6d-4681-8174-45cecf122b01" containerName="pull"
Jul 14 02:07:07.332929 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.332740    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="11251d02-5e6d-4681-8174-45cecf122b01" containerName="extract"
Jul 14 02:07:07.332929 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.332748    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb0aed76-7315-47db-a954-9d5f73178fa5" containerName="console"
Jul 14 02:07:07.335011 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.334994    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"
Jul 14 02:07:07.337463 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.337435    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 14 02:07:07.337618 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.337494    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rjwcs\""
Jul 14 02:07:07.338637 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.338611    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 14 02:07:07.345111 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.345082    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"]
Jul 14 02:07:07.381124 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.381083    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6172e59b-f96c-42bc-830b-afb6187f65c8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2\" (UID: \"6172e59b-f96c-42bc-830b-afb6187f65c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"
Jul 14 02:07:07.381124 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.381123    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6172e59b-f96c-42bc-830b-afb6187f65c8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2\" (UID: \"6172e59b-f96c-42bc-830b-afb6187f65c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"
Jul 14 02:07:07.381365 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.381247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjmtt\" (UniqueName: \"kubernetes.io/projected/6172e59b-f96c-42bc-830b-afb6187f65c8-kube-api-access-jjmtt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2\" (UID: \"6172e59b-f96c-42bc-830b-afb6187f65c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"
Jul 14 02:07:07.481900 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.481852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6172e59b-f96c-42bc-830b-afb6187f65c8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2\" (UID: \"6172e59b-f96c-42bc-830b-afb6187f65c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"
Jul 14 02:07:07.481900 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.481897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6172e59b-f96c-42bc-830b-afb6187f65c8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2\" (UID: \"6172e59b-f96c-42bc-830b-afb6187f65c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"
Jul 14 02:07:07.482159 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.481952    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjmtt\" (UniqueName: \"kubernetes.io/projected/6172e59b-f96c-42bc-830b-afb6187f65c8-kube-api-access-jjmtt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2\" (UID: \"6172e59b-f96c-42bc-830b-afb6187f65c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"
Jul 14 02:07:07.482347 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.482322    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6172e59b-f96c-42bc-830b-afb6187f65c8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2\" (UID: \"6172e59b-f96c-42bc-830b-afb6187f65c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"
Jul 14 02:07:07.482417 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.482340    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6172e59b-f96c-42bc-830b-afb6187f65c8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2\" (UID: \"6172e59b-f96c-42bc-830b-afb6187f65c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"
Jul 14 02:07:07.490491 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.490461    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjmtt\" (UniqueName: \"kubernetes.io/projected/6172e59b-f96c-42bc-830b-afb6187f65c8-kube-api-access-jjmtt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2\" (UID: \"6172e59b-f96c-42bc-830b-afb6187f65c8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"
Jul 14 02:07:07.645620 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.645533    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"
Jul 14 02:07:07.780878 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:07.780848    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"]
Jul 14 02:07:07.783477 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:07:07.783444    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6172e59b_f96c_42bc_830b_afb6187f65c8.slice/crio-4c704da3288bc1462f400dd2edd07b9ef290a1a1959b750a19ff6c16d7c121d5 WatchSource:0}: Error finding container 4c704da3288bc1462f400dd2edd07b9ef290a1a1959b750a19ff6c16d7c121d5: Status 404 returned error can't find the container with id 4c704da3288bc1462f400dd2edd07b9ef290a1a1959b750a19ff6c16d7c121d5
Jul 14 02:07:08.591640 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:08.591602    2563 generic.go:356] "Generic (PLEG): container finished" podID="6172e59b-f96c-42bc-830b-afb6187f65c8" containerID="3d3290b94a2452d3a69d19a53bc5b2f2bce5500f8fd6bd49e8943578c8316f80" exitCode=0
Jul 14 02:07:08.592106 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:08.591692    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2" event={"ID":"6172e59b-f96c-42bc-830b-afb6187f65c8","Type":"ContainerDied","Data":"3d3290b94a2452d3a69d19a53bc5b2f2bce5500f8fd6bd49e8943578c8316f80"}
Jul 14 02:07:08.592106 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:08.591756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2" event={"ID":"6172e59b-f96c-42bc-830b-afb6187f65c8","Type":"ContainerStarted","Data":"4c704da3288bc1462f400dd2edd07b9ef290a1a1959b750a19ff6c16d7c121d5"}
Jul 14 02:07:10.504728 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:10.504695    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zg266"]
Jul 14 02:07:10.506752 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:10.506733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zg266"
Jul 14 02:07:10.509260 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:10.509238    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 14 02:07:10.509398 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:10.509281    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 14 02:07:10.510358 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:10.510343    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9fxx6\""
Jul 14 02:07:10.515104 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:10.515077    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zg266"]
Jul 14 02:07:10.604056 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:10.604015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2" event={"ID":"6172e59b-f96c-42bc-830b-afb6187f65c8","Type":"ContainerStarted","Data":"20e8e7d60f3d32269c572f217bdd68d1ba2a898c7a04001ad772ee36f122c1c9"}
Jul 14 02:07:10.606643 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:10.606619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38a09979-06be-4aa1-a2a5-7a22bd7c17da-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zg266\" (UID: \"38a09979-06be-4aa1-a2a5-7a22bd7c17da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zg266"
Jul 14 02:07:10.606724 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:10.606681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbmjv\" (UniqueName: \"kubernetes.io/projected/38a09979-06be-4aa1-a2a5-7a22bd7c17da-kube-api-access-jbmjv\") pod \"cert-manager-cainjector-559cdd8c87-zg266\" (UID: \"38a09979-06be-4aa1-a2a5-7a22bd7c17da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zg266"
Jul 14 02:07:10.708092 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:10.708047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbmjv\" (UniqueName: \"kubernetes.io/projected/38a09979-06be-4aa1-a2a5-7a22bd7c17da-kube-api-access-jbmjv\") pod \"cert-manager-cainjector-559cdd8c87-zg266\" (UID: \"38a09979-06be-4aa1-a2a5-7a22bd7c17da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zg266"
Jul 14 02:07:10.708304 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:10.708133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38a09979-06be-4aa1-a2a5-7a22bd7c17da-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zg266\" (UID: \"38a09979-06be-4aa1-a2a5-7a22bd7c17da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zg266"
Jul 14 02:07:10.717186 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:10.717147    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38a09979-06be-4aa1-a2a5-7a22bd7c17da-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zg266\" (UID: \"38a09979-06be-4aa1-a2a5-7a22bd7c17da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zg266"
Jul 14 02:07:10.717315 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:10.717217    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbmjv\" (UniqueName: \"kubernetes.io/projected/38a09979-06be-4aa1-a2a5-7a22bd7c17da-kube-api-access-jbmjv\") pod \"cert-manager-cainjector-559cdd8c87-zg266\" (UID: \"38a09979-06be-4aa1-a2a5-7a22bd7c17da\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zg266"
Jul 14 02:07:10.827249 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:10.827216    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zg266"
Jul 14 02:07:10.967328 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:10.967201    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zg266"]
Jul 14 02:07:10.969696 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:07:10.969664    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38a09979_06be_4aa1_a2a5_7a22bd7c17da.slice/crio-daf97823ebd188bf150261058d3695be07c37064e006eecc8f69a915535673b4 WatchSource:0}: Error finding container daf97823ebd188bf150261058d3695be07c37064e006eecc8f69a915535673b4: Status 404 returned error can't find the container with id daf97823ebd188bf150261058d3695be07c37064e006eecc8f69a915535673b4
Jul 14 02:07:11.609400 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:11.609351    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zg266" event={"ID":"38a09979-06be-4aa1-a2a5-7a22bd7c17da","Type":"ContainerStarted","Data":"daf97823ebd188bf150261058d3695be07c37064e006eecc8f69a915535673b4"}
Jul 14 02:07:11.611194 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:11.611145    2563 generic.go:356] "Generic (PLEG): container finished" podID="6172e59b-f96c-42bc-830b-afb6187f65c8" containerID="20e8e7d60f3d32269c572f217bdd68d1ba2a898c7a04001ad772ee36f122c1c9" exitCode=0
Jul 14 02:07:11.611330 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:11.611225    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2" event={"ID":"6172e59b-f96c-42bc-830b-afb6187f65c8","Type":"ContainerDied","Data":"20e8e7d60f3d32269c572f217bdd68d1ba2a898c7a04001ad772ee36f122c1c9"}
Jul 14 02:07:12.619565 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:12.619520    2563 generic.go:356] "Generic (PLEG): container finished" podID="6172e59b-f96c-42bc-830b-afb6187f65c8" containerID="acbeefbe5efc0a393bb83d6d150319333a1ca9ec723a4f2047bedeea17aac2b3" exitCode=0
Jul 14 02:07:12.620036 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:12.619571    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2" event={"ID":"6172e59b-f96c-42bc-830b-afb6187f65c8","Type":"ContainerDied","Data":"acbeefbe5efc0a393bb83d6d150319333a1ca9ec723a4f2047bedeea17aac2b3"}
Jul 14 02:07:14.083346 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:14.083315    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"
Jul 14 02:07:14.149839 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:14.149810    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6172e59b-f96c-42bc-830b-afb6187f65c8-bundle\") pod \"6172e59b-f96c-42bc-830b-afb6187f65c8\" (UID: \"6172e59b-f96c-42bc-830b-afb6187f65c8\") "
Jul 14 02:07:14.149976 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:14.149887    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6172e59b-f96c-42bc-830b-afb6187f65c8-util\") pod \"6172e59b-f96c-42bc-830b-afb6187f65c8\" (UID: \"6172e59b-f96c-42bc-830b-afb6187f65c8\") "
Jul 14 02:07:14.149976 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:14.149911    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjmtt\" (UniqueName: \"kubernetes.io/projected/6172e59b-f96c-42bc-830b-afb6187f65c8-kube-api-access-jjmtt\") pod \"6172e59b-f96c-42bc-830b-afb6187f65c8\" (UID: \"6172e59b-f96c-42bc-830b-afb6187f65c8\") "
Jul 14 02:07:14.150346 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:14.150317    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6172e59b-f96c-42bc-830b-afb6187f65c8-bundle" (OuterVolumeSpecName: "bundle") pod "6172e59b-f96c-42bc-830b-afb6187f65c8" (UID: "6172e59b-f96c-42bc-830b-afb6187f65c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:07:14.152588 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:14.152557    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6172e59b-f96c-42bc-830b-afb6187f65c8-kube-api-access-jjmtt" (OuterVolumeSpecName: "kube-api-access-jjmtt") pod "6172e59b-f96c-42bc-830b-afb6187f65c8" (UID: "6172e59b-f96c-42bc-830b-afb6187f65c8"). InnerVolumeSpecName "kube-api-access-jjmtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:07:14.155122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:14.155095    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6172e59b-f96c-42bc-830b-afb6187f65c8-util" (OuterVolumeSpecName: "util") pod "6172e59b-f96c-42bc-830b-afb6187f65c8" (UID: "6172e59b-f96c-42bc-830b-afb6187f65c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:07:14.251477 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:14.251440    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6172e59b-f96c-42bc-830b-afb6187f65c8-bundle\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:07:14.251477 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:14.251472    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6172e59b-f96c-42bc-830b-afb6187f65c8-util\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:07:14.251477 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:14.251481    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjmtt\" (UniqueName: \"kubernetes.io/projected/6172e59b-f96c-42bc-830b-afb6187f65c8-kube-api-access-jjmtt\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:07:14.632250 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:14.632209    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zg266" event={"ID":"38a09979-06be-4aa1-a2a5-7a22bd7c17da","Type":"ContainerStarted","Data":"b0ab96d7dbfa211b4f6944c3af3fa2099e78dd12300daa4ff3ad9ce6868f9f4a"}
Jul 14 02:07:14.634114 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:14.634090    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2"
Jul 14 02:07:14.634277 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:14.634090    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ff82c2" event={"ID":"6172e59b-f96c-42bc-830b-afb6187f65c8","Type":"ContainerDied","Data":"4c704da3288bc1462f400dd2edd07b9ef290a1a1959b750a19ff6c16d7c121d5"}
Jul 14 02:07:14.634277 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:14.634229    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c704da3288bc1462f400dd2edd07b9ef290a1a1959b750a19ff6c16d7c121d5"
Jul 14 02:07:14.649056 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:14.649008    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zg266" podStartSLOduration=1.4919129 podStartE2EDuration="4.648990084s" totalImagesPullingTime="3.157077184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:07:14.646150033 +0000 UTC m=+355.328720870" watchObservedRunningTime="2026-07-14 02:07:14.648990084 +0000 UTC m=+355.331560920"
Jul 14 02:07:15.094632 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.094587    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-x5kmx"]
Jul 14 02:07:15.094995 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.094959    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6172e59b-f96c-42bc-830b-afb6187f65c8" containerName="extract"
Jul 14 02:07:15.094995 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.094972    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6172e59b-f96c-42bc-830b-afb6187f65c8" containerName="extract"
Jul 14 02:07:15.094995 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.094980    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6172e59b-f96c-42bc-830b-afb6187f65c8" containerName="pull"
Jul 14 02:07:15.094995 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.094985    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6172e59b-f96c-42bc-830b-afb6187f65c8" containerName="pull"
Jul 14 02:07:15.095131 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.094998    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6172e59b-f96c-42bc-830b-afb6187f65c8" containerName="util"
Jul 14 02:07:15.095131 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.095005    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6172e59b-f96c-42bc-830b-afb6187f65c8" containerName="util"
Jul 14 02:07:15.095131 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.095060    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6172e59b-f96c-42bc-830b-afb6187f65c8" containerName="extract"
Jul 14 02:07:15.098702 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.098686    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-x5kmx"
Jul 14 02:07:15.100947 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.100915    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-hb52v\""
Jul 14 02:07:15.106784 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.106758    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-x5kmx"]
Jul 14 02:07:15.160878 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.160842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1996986-8132-4360-8af1-b7b866b035fb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-x5kmx\" (UID: \"d1996986-8132-4360-8af1-b7b866b035fb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x5kmx"
Jul 14 02:07:15.161056 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.160956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx2hm\" (UniqueName: \"kubernetes.io/projected/d1996986-8132-4360-8af1-b7b866b035fb-kube-api-access-tx2hm\") pod \"cert-manager-webhook-6486ffd997-x5kmx\" (UID: \"d1996986-8132-4360-8af1-b7b866b035fb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x5kmx"
Jul 14 02:07:15.262239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.262162    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx2hm\" (UniqueName: \"kubernetes.io/projected/d1996986-8132-4360-8af1-b7b866b035fb-kube-api-access-tx2hm\") pod \"cert-manager-webhook-6486ffd997-x5kmx\" (UID: \"d1996986-8132-4360-8af1-b7b866b035fb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x5kmx"
Jul 14 02:07:15.262423 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.262348    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1996986-8132-4360-8af1-b7b866b035fb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-x5kmx\" (UID: \"d1996986-8132-4360-8af1-b7b866b035fb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x5kmx"
Jul 14 02:07:15.270441 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.270412    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d1996986-8132-4360-8af1-b7b866b035fb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-x5kmx\" (UID: \"d1996986-8132-4360-8af1-b7b866b035fb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x5kmx"
Jul 14 02:07:15.270603 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.270547    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx2hm\" (UniqueName: \"kubernetes.io/projected/d1996986-8132-4360-8af1-b7b866b035fb-kube-api-access-tx2hm\") pod \"cert-manager-webhook-6486ffd997-x5kmx\" (UID: \"d1996986-8132-4360-8af1-b7b866b035fb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x5kmx"
Jul 14 02:07:15.408784 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.408692    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-x5kmx"
Jul 14 02:07:15.545687 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.545652    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-x5kmx"]
Jul 14 02:07:15.548518 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:07:15.548490    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1996986_8132_4360_8af1_b7b866b035fb.slice/crio-c0d5ff1b8e7bf77a065913edfd05f075596424ef3295a211f24183bc11839cf2 WatchSource:0}: Error finding container c0d5ff1b8e7bf77a065913edfd05f075596424ef3295a211f24183bc11839cf2: Status 404 returned error can't find the container with id c0d5ff1b8e7bf77a065913edfd05f075596424ef3295a211f24183bc11839cf2
Jul 14 02:07:15.641566 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.641522    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-x5kmx" event={"ID":"d1996986-8132-4360-8af1-b7b866b035fb","Type":"ContainerStarted","Data":"003f9cec3a16c5fad84bc10925a9ff9ea0e09659c4b31dc8599f22223dba8c50"}
Jul 14 02:07:15.641759 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.641584    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-x5kmx" event={"ID":"d1996986-8132-4360-8af1-b7b866b035fb","Type":"ContainerStarted","Data":"c0d5ff1b8e7bf77a065913edfd05f075596424ef3295a211f24183bc11839cf2"}
Jul 14 02:07:15.641759 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.641616    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-x5kmx"
Jul 14 02:07:15.657094 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:15.657027    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-x5kmx" podStartSLOduration=0.65700763 podStartE2EDuration="657.00763ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:07:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:07:15.656220656 +0000 UTC m=+356.338791494" watchObservedRunningTime="2026-07-14 02:07:15.65700763 +0000 UTC m=+356.339578469"
Jul 14 02:07:17.602345 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:17.602307    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-87fj6"]
Jul 14 02:07:17.606225 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:17.606203    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-87fj6"
Jul 14 02:07:17.608685 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:17.608659    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2cp95\""
Jul 14 02:07:17.615712 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:17.615684    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-87fj6"]
Jul 14 02:07:17.686767 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:17.686720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c5de66c-008d-454c-bf0e-7fc8afb5d4de-bound-sa-token\") pod \"cert-manager-55b4d954d5-87fj6\" (UID: \"1c5de66c-008d-454c-bf0e-7fc8afb5d4de\") " pod="cert-manager/cert-manager-55b4d954d5-87fj6"
Jul 14 02:07:17.686962 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:17.686804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9h6v\" (UniqueName: \"kubernetes.io/projected/1c5de66c-008d-454c-bf0e-7fc8afb5d4de-kube-api-access-f9h6v\") pod \"cert-manager-55b4d954d5-87fj6\" (UID: \"1c5de66c-008d-454c-bf0e-7fc8afb5d4de\") " pod="cert-manager/cert-manager-55b4d954d5-87fj6"
Jul 14 02:07:17.787830 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:17.787786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9h6v\" (UniqueName: \"kubernetes.io/projected/1c5de66c-008d-454c-bf0e-7fc8afb5d4de-kube-api-access-f9h6v\") pod \"cert-manager-55b4d954d5-87fj6\" (UID: \"1c5de66c-008d-454c-bf0e-7fc8afb5d4de\") " pod="cert-manager/cert-manager-55b4d954d5-87fj6"
Jul 14 02:07:17.788020 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:17.787862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c5de66c-008d-454c-bf0e-7fc8afb5d4de-bound-sa-token\") pod \"cert-manager-55b4d954d5-87fj6\" (UID: \"1c5de66c-008d-454c-bf0e-7fc8afb5d4de\") " pod="cert-manager/cert-manager-55b4d954d5-87fj6"
Jul 14 02:07:17.795691 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:17.795654    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c5de66c-008d-454c-bf0e-7fc8afb5d4de-bound-sa-token\") pod \"cert-manager-55b4d954d5-87fj6\" (UID: \"1c5de66c-008d-454c-bf0e-7fc8afb5d4de\") " pod="cert-manager/cert-manager-55b4d954d5-87fj6"
Jul 14 02:07:17.795817 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:17.795739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9h6v\" (UniqueName: \"kubernetes.io/projected/1c5de66c-008d-454c-bf0e-7fc8afb5d4de-kube-api-access-f9h6v\") pod \"cert-manager-55b4d954d5-87fj6\" (UID: \"1c5de66c-008d-454c-bf0e-7fc8afb5d4de\") " pod="cert-manager/cert-manager-55b4d954d5-87fj6"
Jul 14 02:07:17.917012 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:17.916899    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-87fj6"
Jul 14 02:07:18.054848 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:18.051800    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-87fj6"]
Jul 14 02:07:18.058371 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:07:18.058340    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c5de66c_008d_454c_bf0e_7fc8afb5d4de.slice/crio-fca2f51dc991ec5a624a5796115c18e1e0046d4d37c5102993e4bb4af7bda32f WatchSource:0}: Error finding container fca2f51dc991ec5a624a5796115c18e1e0046d4d37c5102993e4bb4af7bda32f: Status 404 returned error can't find the container with id fca2f51dc991ec5a624a5796115c18e1e0046d4d37c5102993e4bb4af7bda32f
Jul 14 02:07:18.657709 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:18.657673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-87fj6" event={"ID":"1c5de66c-008d-454c-bf0e-7fc8afb5d4de","Type":"ContainerStarted","Data":"a4bcea80f0e3e97fbb43ff6e8e2e1a7651d81586e150681cda0ac7781eca97a5"}
Jul 14 02:07:18.657709 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:18.657720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-87fj6" event={"ID":"1c5de66c-008d-454c-bf0e-7fc8afb5d4de","Type":"ContainerStarted","Data":"fca2f51dc991ec5a624a5796115c18e1e0046d4d37c5102993e4bb4af7bda32f"}
Jul 14 02:07:18.674483 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:18.674422    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-87fj6" podStartSLOduration=1.6744009640000002 podStartE2EDuration="1.674400964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:07:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:07:18.67243099 +0000 UTC m=+359.355001819" watchObservedRunningTime="2026-07-14 02:07:18.674400964 +0000 UTC m=+359.356971801"
Jul 14 02:07:21.649906 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:21.649876    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-x5kmx"
Jul 14 02:07:33.433288 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.433251    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"]
Jul 14 02:07:33.438070 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.438046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"
Jul 14 02:07:33.440605 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.440581    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 14 02:07:33.441748 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.441716    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rjwcs\""
Jul 14 02:07:33.441934 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.441919    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 14 02:07:33.444261 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.444232    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"]
Jul 14 02:07:33.533285 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.533235    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh\" (UID: \"e1752519-1318-42fd-a2e5-19e9e3a6b1d7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"
Jul 14 02:07:33.533285 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.533279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z59w4\" (UniqueName: \"kubernetes.io/projected/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-kube-api-access-z59w4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh\" (UID: \"e1752519-1318-42fd-a2e5-19e9e3a6b1d7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"
Jul 14 02:07:33.533522 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.533357    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh\" (UID: \"e1752519-1318-42fd-a2e5-19e9e3a6b1d7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"
Jul 14 02:07:33.634390 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.634348    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh\" (UID: \"e1752519-1318-42fd-a2e5-19e9e3a6b1d7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"
Jul 14 02:07:33.634577 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.634394    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z59w4\" (UniqueName: \"kubernetes.io/projected/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-kube-api-access-z59w4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh\" (UID: \"e1752519-1318-42fd-a2e5-19e9e3a6b1d7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"
Jul 14 02:07:33.634577 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.634454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh\" (UID: \"e1752519-1318-42fd-a2e5-19e9e3a6b1d7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"
Jul 14 02:07:33.634857 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.634833    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh\" (UID: \"e1752519-1318-42fd-a2e5-19e9e3a6b1d7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"
Jul 14 02:07:33.634904 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.634843    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh\" (UID: \"e1752519-1318-42fd-a2e5-19e9e3a6b1d7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"
Jul 14 02:07:33.643028 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.642988    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z59w4\" (UniqueName: \"kubernetes.io/projected/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-kube-api-access-z59w4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh\" (UID: \"e1752519-1318-42fd-a2e5-19e9e3a6b1d7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"
Jul 14 02:07:33.748461 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.748351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"
Jul 14 02:07:33.884008 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:33.883980    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"]
Jul 14 02:07:33.886227 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:07:33.886195    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1752519_1318_42fd_a2e5_19e9e3a6b1d7.slice/crio-183a7744400e44a6ab1e94d78fee979c23d91046c299f3b9b1ef9c4be6449267 WatchSource:0}: Error finding container 183a7744400e44a6ab1e94d78fee979c23d91046c299f3b9b1ef9c4be6449267: Status 404 returned error can't find the container with id 183a7744400e44a6ab1e94d78fee979c23d91046c299f3b9b1ef9c4be6449267
Jul 14 02:07:34.740073 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:34.740032    2563 generic.go:356] "Generic (PLEG): container finished" podID="e1752519-1318-42fd-a2e5-19e9e3a6b1d7" containerID="b0dedc74c3443bf84aa987a0cb749e388505ab6c2f1cdf6507cfecb022a8ffa6" exitCode=0
Jul 14 02:07:34.740514 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:34.740086    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh" event={"ID":"e1752519-1318-42fd-a2e5-19e9e3a6b1d7","Type":"ContainerDied","Data":"b0dedc74c3443bf84aa987a0cb749e388505ab6c2f1cdf6507cfecb022a8ffa6"}
Jul 14 02:07:34.740514 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:34.740154    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh" event={"ID":"e1752519-1318-42fd-a2e5-19e9e3a6b1d7","Type":"ContainerStarted","Data":"183a7744400e44a6ab1e94d78fee979c23d91046c299f3b9b1ef9c4be6449267"}
Jul 14 02:07:35.746711 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:35.746615    2563 generic.go:356] "Generic (PLEG): container finished" podID="e1752519-1318-42fd-a2e5-19e9e3a6b1d7" containerID="57957fb7602c158d114ae3470b2d79767df560739755f2a69be0818d04e0f752" exitCode=0
Jul 14 02:07:35.747200 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:35.746702    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh" event={"ID":"e1752519-1318-42fd-a2e5-19e9e3a6b1d7","Type":"ContainerDied","Data":"57957fb7602c158d114ae3470b2d79767df560739755f2a69be0818d04e0f752"}
Jul 14 02:07:36.754072 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:36.754036    2563 generic.go:356] "Generic (PLEG): container finished" podID="e1752519-1318-42fd-a2e5-19e9e3a6b1d7" containerID="6bbe4291f395e2b6d6f6fdcc073d90bc1172192b64c1ae0a1c9051ecb5b3aef4" exitCode=0
Jul 14 02:07:36.754565 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:36.754093    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh" event={"ID":"e1752519-1318-42fd-a2e5-19e9e3a6b1d7","Type":"ContainerDied","Data":"6bbe4291f395e2b6d6f6fdcc073d90bc1172192b64c1ae0a1c9051ecb5b3aef4"}
Jul 14 02:07:37.890707 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:37.890681    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"
Jul 14 02:07:38.074952 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:38.074914    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z59w4\" (UniqueName: \"kubernetes.io/projected/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-kube-api-access-z59w4\") pod \"e1752519-1318-42fd-a2e5-19e9e3a6b1d7\" (UID: \"e1752519-1318-42fd-a2e5-19e9e3a6b1d7\") "
Jul 14 02:07:38.074952 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:38.074958    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-bundle\") pod \"e1752519-1318-42fd-a2e5-19e9e3a6b1d7\" (UID: \"e1752519-1318-42fd-a2e5-19e9e3a6b1d7\") "
Jul 14 02:07:38.075229 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:38.074981    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-util\") pod \"e1752519-1318-42fd-a2e5-19e9e3a6b1d7\" (UID: \"e1752519-1318-42fd-a2e5-19e9e3a6b1d7\") "
Jul 14 02:07:38.075684 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:38.075660    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-bundle" (OuterVolumeSpecName: "bundle") pod "e1752519-1318-42fd-a2e5-19e9e3a6b1d7" (UID: "e1752519-1318-42fd-a2e5-19e9e3a6b1d7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:07:38.077042 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:38.077016    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-kube-api-access-z59w4" (OuterVolumeSpecName: "kube-api-access-z59w4") pod "e1752519-1318-42fd-a2e5-19e9e3a6b1d7" (UID: "e1752519-1318-42fd-a2e5-19e9e3a6b1d7"). InnerVolumeSpecName "kube-api-access-z59w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:07:38.080706 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:38.080679    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-util" (OuterVolumeSpecName: "util") pod "e1752519-1318-42fd-a2e5-19e9e3a6b1d7" (UID: "e1752519-1318-42fd-a2e5-19e9e3a6b1d7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:07:38.176147 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:38.176107    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z59w4\" (UniqueName: \"kubernetes.io/projected/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-kube-api-access-z59w4\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:07:38.176360 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:38.176141    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-bundle\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:07:38.176360 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:38.176189    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1752519-1318-42fd-a2e5-19e9e3a6b1d7-util\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:07:38.765517 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:38.765476    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh" event={"ID":"e1752519-1318-42fd-a2e5-19e9e3a6b1d7","Type":"ContainerDied","Data":"183a7744400e44a6ab1e94d78fee979c23d91046c299f3b9b1ef9c4be6449267"}
Jul 14 02:07:38.765691 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:38.765530    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="183a7744400e44a6ab1e94d78fee979c23d91046c299f3b9b1ef9c4be6449267"
Jul 14 02:07:38.765691 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:38.765485    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af98hhh"
Jul 14 02:07:41.984074 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:41.984033    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"]
Jul 14 02:07:41.984499 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:41.984395    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1752519-1318-42fd-a2e5-19e9e3a6b1d7" containerName="extract"
Jul 14 02:07:41.984499 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:41.984408    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1752519-1318-42fd-a2e5-19e9e3a6b1d7" containerName="extract"
Jul 14 02:07:41.984499 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:41.984422    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1752519-1318-42fd-a2e5-19e9e3a6b1d7" containerName="util"
Jul 14 02:07:41.984499 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:41.984428    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1752519-1318-42fd-a2e5-19e9e3a6b1d7" containerName="util"
Jul 14 02:07:41.984499 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:41.984439    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1752519-1318-42fd-a2e5-19e9e3a6b1d7" containerName="pull"
Jul 14 02:07:41.984499 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:41.984445    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1752519-1318-42fd-a2e5-19e9e3a6b1d7" containerName="pull"
Jul 14 02:07:41.984499 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:41.984499    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1752519-1318-42fd-a2e5-19e9e3a6b1d7" containerName="extract"
Jul 14 02:07:41.986626 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:41.986605    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:07:41.989469 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:41.989448    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gxlns\""
Jul 14 02:07:41.989602 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:41.989448    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 14 02:07:41.990834 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:41.990813    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 14 02:07:41.990959 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:41.990911    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 14 02:07:41.990959 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:41.990928    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 14 02:07:41.991059 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:41.990935    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 14 02:07:42.009290 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.009258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"]
Jul 14 02:07:42.010194 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.010151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwsqc\" (UniqueName: \"kubernetes.io/projected/4cee436a-ba57-4bee-b215-b2e17e5caf2e-kube-api-access-qwsqc\") pod \"lws-controller-manager-7cbf965c66-mqkzf\" (UID: \"4cee436a-ba57-4bee-b215-b2e17e5caf2e\") " pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:07:42.010334 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.010259    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4cee436a-ba57-4bee-b215-b2e17e5caf2e-manager-config\") pod \"lws-controller-manager-7cbf965c66-mqkzf\" (UID: \"4cee436a-ba57-4bee-b215-b2e17e5caf2e\") " pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:07:42.010418 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.010397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cee436a-ba57-4bee-b215-b2e17e5caf2e-cert\") pod \"lws-controller-manager-7cbf965c66-mqkzf\" (UID: \"4cee436a-ba57-4bee-b215-b2e17e5caf2e\") " pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:07:42.010457 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.010441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cee436a-ba57-4bee-b215-b2e17e5caf2e-metrics-cert\") pod \"lws-controller-manager-7cbf965c66-mqkzf\" (UID: \"4cee436a-ba57-4bee-b215-b2e17e5caf2e\") " pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:07:42.111729 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.111687    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cee436a-ba57-4bee-b215-b2e17e5caf2e-cert\") pod \"lws-controller-manager-7cbf965c66-mqkzf\" (UID: \"4cee436a-ba57-4bee-b215-b2e17e5caf2e\") " pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:07:42.111729 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.111730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cee436a-ba57-4bee-b215-b2e17e5caf2e-metrics-cert\") pod \"lws-controller-manager-7cbf965c66-mqkzf\" (UID: \"4cee436a-ba57-4bee-b215-b2e17e5caf2e\") " pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:07:42.112009 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.111756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwsqc\" (UniqueName: \"kubernetes.io/projected/4cee436a-ba57-4bee-b215-b2e17e5caf2e-kube-api-access-qwsqc\") pod \"lws-controller-manager-7cbf965c66-mqkzf\" (UID: \"4cee436a-ba57-4bee-b215-b2e17e5caf2e\") " pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:07:42.112009 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.111786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4cee436a-ba57-4bee-b215-b2e17e5caf2e-manager-config\") pod \"lws-controller-manager-7cbf965c66-mqkzf\" (UID: \"4cee436a-ba57-4bee-b215-b2e17e5caf2e\") " pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:07:42.112445 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.112425    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4cee436a-ba57-4bee-b215-b2e17e5caf2e-manager-config\") pod \"lws-controller-manager-7cbf965c66-mqkzf\" (UID: \"4cee436a-ba57-4bee-b215-b2e17e5caf2e\") " pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:07:42.114426 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.114395    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4cee436a-ba57-4bee-b215-b2e17e5caf2e-metrics-cert\") pod \"lws-controller-manager-7cbf965c66-mqkzf\" (UID: \"4cee436a-ba57-4bee-b215-b2e17e5caf2e\") " pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:07:42.114548 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.114531    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cee436a-ba57-4bee-b215-b2e17e5caf2e-cert\") pod \"lws-controller-manager-7cbf965c66-mqkzf\" (UID: \"4cee436a-ba57-4bee-b215-b2e17e5caf2e\") " pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:07:42.124631 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.124606    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwsqc\" (UniqueName: \"kubernetes.io/projected/4cee436a-ba57-4bee-b215-b2e17e5caf2e-kube-api-access-qwsqc\") pod \"lws-controller-manager-7cbf965c66-mqkzf\" (UID: \"4cee436a-ba57-4bee-b215-b2e17e5caf2e\") " pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:07:42.296431 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.296337    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:07:42.439754 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.439720    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"]
Jul 14 02:07:42.442984 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:07:42.442956    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cee436a_ba57_4bee_b215_b2e17e5caf2e.slice/crio-c54cce30d09f9824a641c1131329a09b5a19b19423fdd6ac5eeee1951ca71f0b WatchSource:0}: Error finding container c54cce30d09f9824a641c1131329a09b5a19b19423fdd6ac5eeee1951ca71f0b: Status 404 returned error can't find the container with id c54cce30d09f9824a641c1131329a09b5a19b19423fdd6ac5eeee1951ca71f0b
Jul 14 02:07:42.787427 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:42.787391    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf" event={"ID":"4cee436a-ba57-4bee-b215-b2e17e5caf2e","Type":"ContainerStarted","Data":"c54cce30d09f9824a641c1131329a09b5a19b19423fdd6ac5eeee1951ca71f0b"}
Jul 14 02:07:44.804705 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:44.804665    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf" event={"ID":"4cee436a-ba57-4bee-b215-b2e17e5caf2e","Type":"ContainerStarted","Data":"ebadaeaa4ac83b06fdd40f9ad8e5f88fd6cc6c8076e6eb14cbf0b25ef6622e26"}
Jul 14 02:07:44.805154 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:44.804794    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:07:44.821854 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:44.821803    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf" podStartSLOduration=2.373501567 podStartE2EDuration="3.821788244s" totalImagesPullingTime="1.448286677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:07:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:07:44.821290132 +0000 UTC m=+385.503861016" watchObservedRunningTime="2026-07-14 02:07:44.821788244 +0000 UTC m=+385.504359124"
Jul 14 02:07:45.372085 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.372038    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"]
Jul 14 02:07:45.374477 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.374450    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.379020 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.378989    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 02:07:45.379204 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.379045    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wpb5w\""
Jul 14 02:07:45.379204 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.379090    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 02:07:45.380002 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.379986    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 02:07:45.383760 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.383733    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 02:07:45.398186 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.397664    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"]
Jul 14 02:07:45.441650 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.441609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36dce243-e020-4321-b331-28b7fadfdf14-manifests\") pod \"opendatahub-operator-controller-manager-5756559977-m8jzc\" (UID: \"36dce243-e020-4321-b331-28b7fadfdf14\") " pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.441824 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.441745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72f68\" (UniqueName: \"kubernetes.io/projected/36dce243-e020-4321-b331-28b7fadfdf14-kube-api-access-72f68\") pod \"opendatahub-operator-controller-manager-5756559977-m8jzc\" (UID: \"36dce243-e020-4321-b331-28b7fadfdf14\") " pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.441824 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.441799    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36dce243-e020-4321-b331-28b7fadfdf14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5756559977-m8jzc\" (UID: \"36dce243-e020-4321-b331-28b7fadfdf14\") " pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.441824 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.441822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36dce243-e020-4321-b331-28b7fadfdf14-tmp\") pod \"opendatahub-operator-controller-manager-5756559977-m8jzc\" (UID: \"36dce243-e020-4321-b331-28b7fadfdf14\") " pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.441927 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.441837    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36dce243-e020-4321-b331-28b7fadfdf14-webhook-cert\") pod \"opendatahub-operator-controller-manager-5756559977-m8jzc\" (UID: \"36dce243-e020-4321-b331-28b7fadfdf14\") " pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.542909 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.542869    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72f68\" (UniqueName: \"kubernetes.io/projected/36dce243-e020-4321-b331-28b7fadfdf14-kube-api-access-72f68\") pod \"opendatahub-operator-controller-manager-5756559977-m8jzc\" (UID: \"36dce243-e020-4321-b331-28b7fadfdf14\") " pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.543088 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.542922    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36dce243-e020-4321-b331-28b7fadfdf14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5756559977-m8jzc\" (UID: \"36dce243-e020-4321-b331-28b7fadfdf14\") " pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.543088 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.543038    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36dce243-e020-4321-b331-28b7fadfdf14-tmp\") pod \"opendatahub-operator-controller-manager-5756559977-m8jzc\" (UID: \"36dce243-e020-4321-b331-28b7fadfdf14\") " pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.543088 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.543073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36dce243-e020-4321-b331-28b7fadfdf14-webhook-cert\") pod \"opendatahub-operator-controller-manager-5756559977-m8jzc\" (UID: \"36dce243-e020-4321-b331-28b7fadfdf14\") " pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.543263 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.543120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36dce243-e020-4321-b331-28b7fadfdf14-manifests\") pod \"opendatahub-operator-controller-manager-5756559977-m8jzc\" (UID: \"36dce243-e020-4321-b331-28b7fadfdf14\") " pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.543583 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.543532    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36dce243-e020-4321-b331-28b7fadfdf14-manifests\") pod \"opendatahub-operator-controller-manager-5756559977-m8jzc\" (UID: \"36dce243-e020-4321-b331-28b7fadfdf14\") " pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.545822 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.545795    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36dce243-e020-4321-b331-28b7fadfdf14-webhook-cert\") pod \"opendatahub-operator-controller-manager-5756559977-m8jzc\" (UID: \"36dce243-e020-4321-b331-28b7fadfdf14\") " pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.545951 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.545849    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36dce243-e020-4321-b331-28b7fadfdf14-tmp\") pod \"opendatahub-operator-controller-manager-5756559977-m8jzc\" (UID: \"36dce243-e020-4321-b331-28b7fadfdf14\") " pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.546073 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.546051    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36dce243-e020-4321-b331-28b7fadfdf14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5756559977-m8jzc\" (UID: \"36dce243-e020-4321-b331-28b7fadfdf14\") " pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.551330 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.551308    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72f68\" (UniqueName: \"kubernetes.io/projected/36dce243-e020-4321-b331-28b7fadfdf14-kube-api-access-72f68\") pod \"opendatahub-operator-controller-manager-5756559977-m8jzc\" (UID: \"36dce243-e020-4321-b331-28b7fadfdf14\") " pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.685895 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.685800    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:45.826404 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:45.826370    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"]
Jul 14 02:07:45.829563 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:07:45.829532    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36dce243_e020_4321_b331_28b7fadfdf14.slice/crio-67241adc89caaf56fe31cd21db9f89ff4d84bc6ab0a24f253c271760940b4785 WatchSource:0}: Error finding container 67241adc89caaf56fe31cd21db9f89ff4d84bc6ab0a24f253c271760940b4785: Status 404 returned error can't find the container with id 67241adc89caaf56fe31cd21db9f89ff4d84bc6ab0a24f253c271760940b4785
Jul 14 02:07:46.818484 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:46.818445    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc" event={"ID":"36dce243-e020-4321-b331-28b7fadfdf14","Type":"ContainerStarted","Data":"67241adc89caaf56fe31cd21db9f89ff4d84bc6ab0a24f253c271760940b4785"}
Jul 14 02:07:49.840462 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:49.840414    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc" event={"ID":"36dce243-e020-4321-b331-28b7fadfdf14","Type":"ContainerStarted","Data":"5ff9d955518f578352a55c6c4a8fd96cb2bef0a62406345bf9bdf067d330034b"}
Jul 14 02:07:50.847148 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:50.847110    2563 generic.go:356] "Generic (PLEG): container finished" podID="36dce243-e020-4321-b331-28b7fadfdf14" containerID="5ff9d955518f578352a55c6c4a8fd96cb2bef0a62406345bf9bdf067d330034b" exitCode=0
Jul 14 02:07:50.847552 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:50.847195    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc" event={"ID":"36dce243-e020-4321-b331-28b7fadfdf14","Type":"ContainerDied","Data":"5ff9d955518f578352a55c6c4a8fd96cb2bef0a62406345bf9bdf067d330034b"}
Jul 14 02:07:51.855390 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:51.855355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc" event={"ID":"36dce243-e020-4321-b331-28b7fadfdf14","Type":"ContainerStarted","Data":"2e34a60b856970d527421ea64ee97e268b4b60ea532ca77f828bc99a53ebd900"}
Jul 14 02:07:51.855772 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:51.855410    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:07:51.894183 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:51.894124    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc" podStartSLOduration=2.291102783 podStartE2EDuration="6.89410933s" totalImagesPullingTime="3.455642955s" totalInitContainerRuntime="1.147363592s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:07:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:07:51.891878478 +0000 UTC m=+392.574449340" watchObservedRunningTime="2026-07-14 02:07:51.89410933 +0000 UTC m=+392.576680224"
Jul 14 02:07:55.812654 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:07:55.812622    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7cbf965c66-mqkzf"
Jul 14 02:08:02.862346 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:02.862315    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5756559977-m8jzc"
Jul 14 02:08:15.344067 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.344028    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs"]
Jul 14 02:08:15.347788 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.347768    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs"
Jul 14 02:08:15.351323 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.351294    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 14 02:08:15.351622 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.351602    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 02:08:15.351622 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.351614    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 14 02:08:15.351780 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.351664    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 02:08:15.352548 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.352527    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-hmpcv\""
Jul 14 02:08:15.357895 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.357857    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs"]
Jul 14 02:08:15.521500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.521465    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2fql\" (UniqueName: \"kubernetes.io/projected/1f3942ae-267c-40d9-96ea-171903468426-kube-api-access-k2fql\") pod \"kube-auth-proxy-69dd74468c-7mnrs\" (UID: \"1f3942ae-267c-40d9-96ea-171903468426\") " pod="openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs"
Jul 14 02:08:15.521701 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.521531    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f3942ae-267c-40d9-96ea-171903468426-tmp\") pod \"kube-auth-proxy-69dd74468c-7mnrs\" (UID: \"1f3942ae-267c-40d9-96ea-171903468426\") " pod="openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs"
Jul 14 02:08:15.521701 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.521609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f3942ae-267c-40d9-96ea-171903468426-tls-certs\") pod \"kube-auth-proxy-69dd74468c-7mnrs\" (UID: \"1f3942ae-267c-40d9-96ea-171903468426\") " pod="openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs"
Jul 14 02:08:15.622729 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.622623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f3942ae-267c-40d9-96ea-171903468426-tls-certs\") pod \"kube-auth-proxy-69dd74468c-7mnrs\" (UID: \"1f3942ae-267c-40d9-96ea-171903468426\") " pod="openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs"
Jul 14 02:08:15.622729 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.622705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2fql\" (UniqueName: \"kubernetes.io/projected/1f3942ae-267c-40d9-96ea-171903468426-kube-api-access-k2fql\") pod \"kube-auth-proxy-69dd74468c-7mnrs\" (UID: \"1f3942ae-267c-40d9-96ea-171903468426\") " pod="openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs"
Jul 14 02:08:15.622967 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.622746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f3942ae-267c-40d9-96ea-171903468426-tmp\") pod \"kube-auth-proxy-69dd74468c-7mnrs\" (UID: \"1f3942ae-267c-40d9-96ea-171903468426\") " pod="openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs"
Jul 14 02:08:15.625080 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.625053    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f3942ae-267c-40d9-96ea-171903468426-tmp\") pod \"kube-auth-proxy-69dd74468c-7mnrs\" (UID: \"1f3942ae-267c-40d9-96ea-171903468426\") " pod="openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs"
Jul 14 02:08:15.625352 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.625332    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f3942ae-267c-40d9-96ea-171903468426-tls-certs\") pod \"kube-auth-proxy-69dd74468c-7mnrs\" (UID: \"1f3942ae-267c-40d9-96ea-171903468426\") " pod="openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs"
Jul 14 02:08:15.630756 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.630730    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2fql\" (UniqueName: \"kubernetes.io/projected/1f3942ae-267c-40d9-96ea-171903468426-kube-api-access-k2fql\") pod \"kube-auth-proxy-69dd74468c-7mnrs\" (UID: \"1f3942ae-267c-40d9-96ea-171903468426\") " pod="openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs"
Jul 14 02:08:15.659717 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.659680    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs"
Jul 14 02:08:15.798565 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.798541    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs"]
Jul 14 02:08:15.800498 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:08:15.800471    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f3942ae_267c_40d9_96ea_171903468426.slice/crio-01a4a4eb83128ee59aba5c12c73649e4bb3315b29366e21b4c81a5d4a50a62ac WatchSource:0}: Error finding container 01a4a4eb83128ee59aba5c12c73649e4bb3315b29366e21b4c81a5d4a50a62ac: Status 404 returned error can't find the container with id 01a4a4eb83128ee59aba5c12c73649e4bb3315b29366e21b4c81a5d4a50a62ac
Jul 14 02:08:15.976890 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:15.976805    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs" event={"ID":"1f3942ae-267c-40d9-96ea-171903468426","Type":"ContainerStarted","Data":"01a4a4eb83128ee59aba5c12c73649e4bb3315b29366e21b4c81a5d4a50a62ac"}
Jul 14 02:08:19.998625 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:19.998590    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs" event={"ID":"1f3942ae-267c-40d9-96ea-171903468426","Type":"ContainerStarted","Data":"b272ddecd10d2b0555fd49a7f86fbd80d98d63cb74df2b4f01728bbed244a7fd"}
Jul 14 02:08:20.015302 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:08:20.015247    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-69dd74468c-7mnrs" podStartSLOduration=1.761532254 podStartE2EDuration="5.015231791s" totalImagesPullingTime="3.253699537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:08:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:08:20.014330363 +0000 UTC m=+420.696901221" watchObservedRunningTime="2026-07-14 02:08:20.015231791 +0000 UTC m=+420.697802627"
Jul 14 02:09:28.735936 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.735891    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c6cb7fbd5-mqq2n"]
Jul 14 02:09:28.739687 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.739664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.749276 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.749247    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6cb7fbd5-mqq2n"]
Jul 14 02:09:28.867056 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.867014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e942b737-83b0-485e-9b59-dff983aa615e-console-oauth-config\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.867056 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.867063    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcjzc\" (UniqueName: \"kubernetes.io/projected/e942b737-83b0-485e-9b59-dff983aa615e-kube-api-access-vcjzc\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.867374 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.867137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e942b737-83b0-485e-9b59-dff983aa615e-service-ca\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.867374 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.867209    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e942b737-83b0-485e-9b59-dff983aa615e-console-serving-cert\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.867374 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.867237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e942b737-83b0-485e-9b59-dff983aa615e-console-config\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.867374 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.867258    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e942b737-83b0-485e-9b59-dff983aa615e-trusted-ca-bundle\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.867374 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.867279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e942b737-83b0-485e-9b59-dff983aa615e-oauth-serving-cert\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.968582 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.968533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e942b737-83b0-485e-9b59-dff983aa615e-console-oauth-config\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.968835 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.968605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcjzc\" (UniqueName: \"kubernetes.io/projected/e942b737-83b0-485e-9b59-dff983aa615e-kube-api-access-vcjzc\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.968835 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.968731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e942b737-83b0-485e-9b59-dff983aa615e-service-ca\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.968835 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.968761    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e942b737-83b0-485e-9b59-dff983aa615e-console-serving-cert\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.968835 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.968800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e942b737-83b0-485e-9b59-dff983aa615e-console-config\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.968835 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.968829    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e942b737-83b0-485e-9b59-dff983aa615e-trusted-ca-bundle\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.969138 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.968862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e942b737-83b0-485e-9b59-dff983aa615e-oauth-serving-cert\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.969908 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.969879    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e942b737-83b0-485e-9b59-dff983aa615e-trusted-ca-bundle\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.969908 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.969897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e942b737-83b0-485e-9b59-dff983aa615e-console-config\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.970101 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.969921    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e942b737-83b0-485e-9b59-dff983aa615e-oauth-serving-cert\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.970101 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.969979    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e942b737-83b0-485e-9b59-dff983aa615e-service-ca\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.971313 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.971291    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e942b737-83b0-485e-9b59-dff983aa615e-console-oauth-config\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.971825 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.971803    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e942b737-83b0-485e-9b59-dff983aa615e-console-serving-cert\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:28.976316 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:28.976297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcjzc\" (UniqueName: \"kubernetes.io/projected/e942b737-83b0-485e-9b59-dff983aa615e-kube-api-access-vcjzc\") pod \"console-c6cb7fbd5-mqq2n\" (UID: \"e942b737-83b0-485e-9b59-dff983aa615e\") " pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:29.050072 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:29.049980    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:29.189389 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:29.189364    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6cb7fbd5-mqq2n"]
Jul 14 02:09:29.192211 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:09:29.192183    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode942b737_83b0_485e_9b59_dff983aa615e.slice/crio-a69361e70a2c1a2be67dfacdffebc4c0d52ded4c50fabc0bc2a934c5e054b9c4 WatchSource:0}: Error finding container a69361e70a2c1a2be67dfacdffebc4c0d52ded4c50fabc0bc2a934c5e054b9c4: Status 404 returned error can't find the container with id a69361e70a2c1a2be67dfacdffebc4c0d52ded4c50fabc0bc2a934c5e054b9c4
Jul 14 02:09:29.345151 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:29.345117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6cb7fbd5-mqq2n" event={"ID":"e942b737-83b0-485e-9b59-dff983aa615e","Type":"ContainerStarted","Data":"93a4d4fdea138f53e411481b88341b700944a02f58cfc66a6e1d874b4294fd25"}
Jul 14 02:09:29.345355 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:29.345192    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6cb7fbd5-mqq2n" event={"ID":"e942b737-83b0-485e-9b59-dff983aa615e","Type":"ContainerStarted","Data":"a69361e70a2c1a2be67dfacdffebc4c0d52ded4c50fabc0bc2a934c5e054b9c4"}
Jul 14 02:09:29.364319 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:29.364259    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c6cb7fbd5-mqq2n" podStartSLOduration=1.36423884 podStartE2EDuration="1.36423884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:09:29.362155276 +0000 UTC m=+490.044726136" watchObservedRunningTime="2026-07-14 02:09:29.36423884 +0000 UTC m=+490.046809677"
Jul 14 02:09:39.048797 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.048760    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"]
Jul 14 02:09:39.052694 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.052668    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:39.052827 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.052703    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:39.052827 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.052810    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"
Jul 14 02:09:39.055601 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.055578    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ggm5q\""
Jul 14 02:09:39.055729 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.055601    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 02:09:39.055792 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.055772    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:39.056712 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.056690    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 02:09:39.068322 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.068079    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"]
Jul 14 02:09:39.152836 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.152786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90ace907-c5e9-4596-917d-a5d4a546ad21-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb\" (UID: \"90ace907-c5e9-4596-917d-a5d4a546ad21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"
Jul 14 02:09:39.152836 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.152839    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90ace907-c5e9-4596-917d-a5d4a546ad21-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb\" (UID: \"90ace907-c5e9-4596-917d-a5d4a546ad21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"
Jul 14 02:09:39.153113 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.152940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg7jg\" (UniqueName: \"kubernetes.io/projected/90ace907-c5e9-4596-917d-a5d4a546ad21-kube-api-access-kg7jg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb\" (UID: \"90ace907-c5e9-4596-917d-a5d4a546ad21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"
Jul 14 02:09:39.254002 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.253954    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90ace907-c5e9-4596-917d-a5d4a546ad21-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb\" (UID: \"90ace907-c5e9-4596-917d-a5d4a546ad21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"
Jul 14 02:09:39.254236 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.254012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90ace907-c5e9-4596-917d-a5d4a546ad21-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb\" (UID: \"90ace907-c5e9-4596-917d-a5d4a546ad21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"
Jul 14 02:09:39.254236 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.254060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg7jg\" (UniqueName: \"kubernetes.io/projected/90ace907-c5e9-4596-917d-a5d4a546ad21-kube-api-access-kg7jg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb\" (UID: \"90ace907-c5e9-4596-917d-a5d4a546ad21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"
Jul 14 02:09:39.254450 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.254425    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90ace907-c5e9-4596-917d-a5d4a546ad21-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb\" (UID: \"90ace907-c5e9-4596-917d-a5d4a546ad21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"
Jul 14 02:09:39.254495 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.254440    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90ace907-c5e9-4596-917d-a5d4a546ad21-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb\" (UID: \"90ace907-c5e9-4596-917d-a5d4a546ad21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"
Jul 14 02:09:39.262518 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.262490    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg7jg\" (UniqueName: \"kubernetes.io/projected/90ace907-c5e9-4596-917d-a5d4a546ad21-kube-api-access-kg7jg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb\" (UID: \"90ace907-c5e9-4596-917d-a5d4a546ad21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"
Jul 14 02:09:39.372375 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.372306    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"
Jul 14 02:09:39.400063 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.400038    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c6cb7fbd5-mqq2n"
Jul 14 02:09:39.449360 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.449329    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fdbdc75d8-42j2f"]
Jul 14 02:09:39.460020 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.459961    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"]
Jul 14 02:09:39.464902 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.464870    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"
Jul 14 02:09:39.470057 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.470013    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"]
Jul 14 02:09:39.541065 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.541034    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"]
Jul 14 02:09:39.544130 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:09:39.543309    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ace907_c5e9_4596_917d_a5d4a546ad21.slice/crio-c8d17c9b339f102a573e9c1698807bd56b92c6f78f9946e204bc79472fa0ef04 WatchSource:0}: Error finding container c8d17c9b339f102a573e9c1698807bd56b92c6f78f9946e204bc79472fa0ef04: Status 404 returned error can't find the container with id c8d17c9b339f102a573e9c1698807bd56b92c6f78f9946e204bc79472fa0ef04
Jul 14 02:09:39.558794 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.558761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfkwb\" (UniqueName: \"kubernetes.io/projected/392f2074-5af1-4066-be7d-87f972017981-kube-api-access-sfkwb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s\" (UID: \"392f2074-5af1-4066-be7d-87f972017981\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"
Jul 14 02:09:39.558951 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.558822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/392f2074-5af1-4066-be7d-87f972017981-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s\" (UID: \"392f2074-5af1-4066-be7d-87f972017981\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"
Jul 14 02:09:39.558951 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.558869    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/392f2074-5af1-4066-be7d-87f972017981-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s\" (UID: \"392f2074-5af1-4066-be7d-87f972017981\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"
Jul 14 02:09:39.659851 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.659773    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfkwb\" (UniqueName: \"kubernetes.io/projected/392f2074-5af1-4066-be7d-87f972017981-kube-api-access-sfkwb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s\" (UID: \"392f2074-5af1-4066-be7d-87f972017981\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"
Jul 14 02:09:39.659851 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.659825    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/392f2074-5af1-4066-be7d-87f972017981-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s\" (UID: \"392f2074-5af1-4066-be7d-87f972017981\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"
Jul 14 02:09:39.660032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.659861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/392f2074-5af1-4066-be7d-87f972017981-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s\" (UID: \"392f2074-5af1-4066-be7d-87f972017981\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"
Jul 14 02:09:39.660399 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.660308    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/392f2074-5af1-4066-be7d-87f972017981-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s\" (UID: \"392f2074-5af1-4066-be7d-87f972017981\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"
Jul 14 02:09:39.660399 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.660367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/392f2074-5af1-4066-be7d-87f972017981-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s\" (UID: \"392f2074-5af1-4066-be7d-87f972017981\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"
Jul 14 02:09:39.668323 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.668290    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfkwb\" (UniqueName: \"kubernetes.io/projected/392f2074-5af1-4066-be7d-87f972017981-kube-api-access-sfkwb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s\" (UID: \"392f2074-5af1-4066-be7d-87f972017981\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"
Jul 14 02:09:39.783495 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.783455    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"
Jul 14 02:09:39.846118 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.845673    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"]
Jul 14 02:09:39.852275 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.852242    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"
Jul 14 02:09:39.860726 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.860691    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"]
Jul 14 02:09:39.861565 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.861531    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc\" (UID: \"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"
Jul 14 02:09:39.861713 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.861574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svspq\" (UniqueName: \"kubernetes.io/projected/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-kube-api-access-svspq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc\" (UID: \"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"
Jul 14 02:09:39.861713 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.861620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc\" (UID: \"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"
Jul 14 02:09:39.929595 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.928466    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"]
Jul 14 02:09:39.931998 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:09:39.931954    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod392f2074_5af1_4066_be7d_87f972017981.slice/crio-720f194b741896317eade495cd0e048a6aa165145005ff7d8a9d15d669b602a3 WatchSource:0}: Error finding container 720f194b741896317eade495cd0e048a6aa165145005ff7d8a9d15d669b602a3: Status 404 returned error can't find the container with id 720f194b741896317eade495cd0e048a6aa165145005ff7d8a9d15d669b602a3
Jul 14 02:09:39.962329 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.962300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc\" (UID: \"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"
Jul 14 02:09:39.962465 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.962370    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc\" (UID: \"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"
Jul 14 02:09:39.962465 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.962391    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svspq\" (UniqueName: \"kubernetes.io/projected/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-kube-api-access-svspq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc\" (UID: \"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"
Jul 14 02:09:39.962738 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.962715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc\" (UID: \"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"
Jul 14 02:09:39.962775 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.962728    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc\" (UID: \"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"
Jul 14 02:09:39.970250 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:39.970221    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svspq\" (UniqueName: \"kubernetes.io/projected/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-kube-api-access-svspq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc\" (UID: \"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"
Jul 14 02:09:40.165178 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.165134    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"
Jul 14 02:09:40.307290 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.307258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"]
Jul 14 02:09:40.309743 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:09:40.309710    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe30c9f_bd1e_4d59_9fd8_36bfb13c3f92.slice/crio-4668394cc97ec88a30f190f8b3f5414173bdcfaf54b5c4fa3065f26908c53fd2 WatchSource:0}: Error finding container 4668394cc97ec88a30f190f8b3f5414173bdcfaf54b5c4fa3065f26908c53fd2: Status 404 returned error can't find the container with id 4668394cc97ec88a30f190f8b3f5414173bdcfaf54b5c4fa3065f26908c53fd2
Jul 14 02:09:40.404729 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.404692    2563 generic.go:356] "Generic (PLEG): container finished" podID="392f2074-5af1-4066-be7d-87f972017981" containerID="6d58da9aa0d2b90912a62c39f6006e48ccbfd51c34ac422946c835593ccd4167" exitCode=0
Jul 14 02:09:40.404922 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.404829    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s" event={"ID":"392f2074-5af1-4066-be7d-87f972017981","Type":"ContainerDied","Data":"6d58da9aa0d2b90912a62c39f6006e48ccbfd51c34ac422946c835593ccd4167"}
Jul 14 02:09:40.404922 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.404886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s" event={"ID":"392f2074-5af1-4066-be7d-87f972017981","Type":"ContainerStarted","Data":"720f194b741896317eade495cd0e048a6aa165145005ff7d8a9d15d669b602a3"}
Jul 14 02:09:40.406585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.406550    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc" event={"ID":"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92","Type":"ContainerStarted","Data":"d8a5682c6809bc9da12abbd84242a809005daa9b1d3aa18290d56fa681ef180a"}
Jul 14 02:09:40.406706 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.406604    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc" event={"ID":"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92","Type":"ContainerStarted","Data":"4668394cc97ec88a30f190f8b3f5414173bdcfaf54b5c4fa3065f26908c53fd2"}
Jul 14 02:09:40.408245 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.408218    2563 generic.go:356] "Generic (PLEG): container finished" podID="90ace907-c5e9-4596-917d-a5d4a546ad21" containerID="d02e611103d9e29d7bceabdb379eb9f93b49821f4ae87ac42455a5b6f5894e84" exitCode=0
Jul 14 02:09:40.408346 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.408320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb" event={"ID":"90ace907-c5e9-4596-917d-a5d4a546ad21","Type":"ContainerDied","Data":"d02e611103d9e29d7bceabdb379eb9f93b49821f4ae87ac42455a5b6f5894e84"}
Jul 14 02:09:40.408414 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.408374    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb" event={"ID":"90ace907-c5e9-4596-917d-a5d4a546ad21","Type":"ContainerStarted","Data":"c8d17c9b339f102a573e9c1698807bd56b92c6f78f9946e204bc79472fa0ef04"}
Jul 14 02:09:40.450926 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.450892    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"]
Jul 14 02:09:40.454716 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.454691    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"
Jul 14 02:09:40.466185 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.466126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngqtg\" (UniqueName: \"kubernetes.io/projected/729913af-5015-4678-abb1-15b74734d779-kube-api-access-ngqtg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88\" (UID: \"729913af-5015-4678-abb1-15b74734d779\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"
Jul 14 02:09:40.466633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.466487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/729913af-5015-4678-abb1-15b74734d779-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88\" (UID: \"729913af-5015-4678-abb1-15b74734d779\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"
Jul 14 02:09:40.466633 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.466550    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/729913af-5015-4678-abb1-15b74734d779-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88\" (UID: \"729913af-5015-4678-abb1-15b74734d779\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"
Jul 14 02:09:40.490146 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.488568    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"]
Jul 14 02:09:40.567266 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.567224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngqtg\" (UniqueName: \"kubernetes.io/projected/729913af-5015-4678-abb1-15b74734d779-kube-api-access-ngqtg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88\" (UID: \"729913af-5015-4678-abb1-15b74734d779\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"
Jul 14 02:09:40.567435 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.567356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/729913af-5015-4678-abb1-15b74734d779-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88\" (UID: \"729913af-5015-4678-abb1-15b74734d779\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"
Jul 14 02:09:40.567435 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.567387    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/729913af-5015-4678-abb1-15b74734d779-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88\" (UID: \"729913af-5015-4678-abb1-15b74734d779\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"
Jul 14 02:09:40.567758 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.567735    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/729913af-5015-4678-abb1-15b74734d779-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88\" (UID: \"729913af-5015-4678-abb1-15b74734d779\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"
Jul 14 02:09:40.567807 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.567748    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/729913af-5015-4678-abb1-15b74734d779-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88\" (UID: \"729913af-5015-4678-abb1-15b74734d779\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"
Jul 14 02:09:40.576060 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.576024    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngqtg\" (UniqueName: \"kubernetes.io/projected/729913af-5015-4678-abb1-15b74734d779-kube-api-access-ngqtg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88\" (UID: \"729913af-5015-4678-abb1-15b74734d779\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"
Jul 14 02:09:40.801698 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.801612    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"
Jul 14 02:09:40.951121 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:40.951090    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"]
Jul 14 02:09:40.995036 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:09:40.995004    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod729913af_5015_4678_abb1_15b74734d779.slice/crio-9c98d20064e01e51e9c82000cf359ac50131ad8a105a4549a36644e376f6259a WatchSource:0}: Error finding container 9c98d20064e01e51e9c82000cf359ac50131ad8a105a4549a36644e376f6259a: Status 404 returned error can't find the container with id 9c98d20064e01e51e9c82000cf359ac50131ad8a105a4549a36644e376f6259a
Jul 14 02:09:41.417103 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:41.417073    2563 generic.go:356] "Generic (PLEG): container finished" podID="729913af-5015-4678-abb1-15b74734d779" containerID="b8026ca35b9708a6c764801c2299b748f36824e741317bb86d2ec134c20f8b04" exitCode=0
Jul 14 02:09:41.417531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:41.417159    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88" event={"ID":"729913af-5015-4678-abb1-15b74734d779","Type":"ContainerDied","Data":"b8026ca35b9708a6c764801c2299b748f36824e741317bb86d2ec134c20f8b04"}
Jul 14 02:09:41.417531 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:41.417247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88" event={"ID":"729913af-5015-4678-abb1-15b74734d779","Type":"ContainerStarted","Data":"9c98d20064e01e51e9c82000cf359ac50131ad8a105a4549a36644e376f6259a"}
Jul 14 02:09:41.419218 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:41.419192    2563 generic.go:356] "Generic (PLEG): container finished" podID="fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92" containerID="d8a5682c6809bc9da12abbd84242a809005daa9b1d3aa18290d56fa681ef180a" exitCode=0
Jul 14 02:09:41.419338 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:41.419236    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc" event={"ID":"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92","Type":"ContainerDied","Data":"d8a5682c6809bc9da12abbd84242a809005daa9b1d3aa18290d56fa681ef180a"}
Jul 14 02:09:42.426416 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:42.426378    2563 generic.go:356] "Generic (PLEG): container finished" podID="392f2074-5af1-4066-be7d-87f972017981" containerID="8867f1fd5ce4534647d0a13e927e1a3683c5f1f440e4f0c7ea317cc0bdc2bf15" exitCode=0
Jul 14 02:09:42.426875 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:42.426470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s" event={"ID":"392f2074-5af1-4066-be7d-87f972017981","Type":"ContainerDied","Data":"8867f1fd5ce4534647d0a13e927e1a3683c5f1f440e4f0c7ea317cc0bdc2bf15"}
Jul 14 02:09:42.428658 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:42.428627    2563 generic.go:356] "Generic (PLEG): container finished" podID="fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92" containerID="7582af9df4a5caab5c6df9bddbb1c55a2af1bf51af0375a916af1626c548283d" exitCode=0
Jul 14 02:09:42.428747 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:42.428711    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc" event={"ID":"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92","Type":"ContainerDied","Data":"7582af9df4a5caab5c6df9bddbb1c55a2af1bf51af0375a916af1626c548283d"}
Jul 14 02:09:42.430679 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:42.430656    2563 generic.go:356] "Generic (PLEG): container finished" podID="90ace907-c5e9-4596-917d-a5d4a546ad21" containerID="835f463947656d2bed1edd72cb3c2249a83a6f6e6f01f17c2c6726ac785b8b46" exitCode=0
Jul 14 02:09:42.430778 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:42.430736    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb" event={"ID":"90ace907-c5e9-4596-917d-a5d4a546ad21","Type":"ContainerDied","Data":"835f463947656d2bed1edd72cb3c2249a83a6f6e6f01f17c2c6726ac785b8b46"}
Jul 14 02:09:42.432715 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:42.432690    2563 generic.go:356] "Generic (PLEG): container finished" podID="729913af-5015-4678-abb1-15b74734d779" containerID="1a4791393b2095e64157d72bcf817bccc15a377a8dc68f2934c27d303412b25e" exitCode=0
Jul 14 02:09:42.432789 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:42.432735    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88" event={"ID":"729913af-5015-4678-abb1-15b74734d779","Type":"ContainerDied","Data":"1a4791393b2095e64157d72bcf817bccc15a377a8dc68f2934c27d303412b25e"}
Jul 14 02:09:43.439923 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:43.439889    2563 generic.go:356] "Generic (PLEG): container finished" podID="729913af-5015-4678-abb1-15b74734d779" containerID="2ce8b251545ef0c97d1cf9fa9247a540522e1db55535f710e9d21db7585441ac" exitCode=0
Jul 14 02:09:43.440359 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:43.439971    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88" event={"ID":"729913af-5015-4678-abb1-15b74734d779","Type":"ContainerDied","Data":"2ce8b251545ef0c97d1cf9fa9247a540522e1db55535f710e9d21db7585441ac"}
Jul 14 02:09:43.442024 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:43.442002    2563 generic.go:356] "Generic (PLEG): container finished" podID="392f2074-5af1-4066-be7d-87f972017981" containerID="29a0b7a19b92a64eb0a204ad6ce0310283dbbfc6352c15bf7c9c75ac010f00e4" exitCode=0
Jul 14 02:09:43.442133 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:43.442080    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s" event={"ID":"392f2074-5af1-4066-be7d-87f972017981","Type":"ContainerDied","Data":"29a0b7a19b92a64eb0a204ad6ce0310283dbbfc6352c15bf7c9c75ac010f00e4"}
Jul 14 02:09:43.444150 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:43.444130    2563 generic.go:356] "Generic (PLEG): container finished" podID="fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92" containerID="6454137bc326c346f098c9eba5d533ae3773caf11acdc1a4e5543c522671b354" exitCode=0
Jul 14 02:09:43.444255 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:43.444157    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc" event={"ID":"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92","Type":"ContainerDied","Data":"6454137bc326c346f098c9eba5d533ae3773caf11acdc1a4e5543c522671b354"}
Jul 14 02:09:43.446153 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:43.446132    2563 generic.go:356] "Generic (PLEG): container finished" podID="90ace907-c5e9-4596-917d-a5d4a546ad21" containerID="0464e24d8887619e3757a67e92fa0f39e5282b5f11c0fcbb374f1e26b7f1306a" exitCode=0
Jul 14 02:09:43.446260 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:43.446162    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb" event={"ID":"90ace907-c5e9-4596-917d-a5d4a546ad21","Type":"ContainerDied","Data":"0464e24d8887619e3757a67e92fa0f39e5282b5f11c0fcbb374f1e26b7f1306a"}
Jul 14 02:09:44.622475 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.622439    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"
Jul 14 02:09:44.682361 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.682331    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"
Jul 14 02:09:44.685815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.685789    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"
Jul 14 02:09:44.689450 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.689425    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"
Jul 14 02:09:44.709091 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.709022    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/729913af-5015-4678-abb1-15b74734d779-util\") pod \"729913af-5015-4678-abb1-15b74734d779\" (UID: \"729913af-5015-4678-abb1-15b74734d779\") "
Jul 14 02:09:44.709091 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.709053    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/729913af-5015-4678-abb1-15b74734d779-bundle\") pod \"729913af-5015-4678-abb1-15b74734d779\" (UID: \"729913af-5015-4678-abb1-15b74734d779\") "
Jul 14 02:09:44.709091 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.709075    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90ace907-c5e9-4596-917d-a5d4a546ad21-util\") pod \"90ace907-c5e9-4596-917d-a5d4a546ad21\" (UID: \"90ace907-c5e9-4596-917d-a5d4a546ad21\") "
Jul 14 02:09:44.709349 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.709102    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfkwb\" (UniqueName: \"kubernetes.io/projected/392f2074-5af1-4066-be7d-87f972017981-kube-api-access-sfkwb\") pod \"392f2074-5af1-4066-be7d-87f972017981\" (UID: \"392f2074-5af1-4066-be7d-87f972017981\") "
Jul 14 02:09:44.709349 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.709133    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg7jg\" (UniqueName: \"kubernetes.io/projected/90ace907-c5e9-4596-917d-a5d4a546ad21-kube-api-access-kg7jg\") pod \"90ace907-c5e9-4596-917d-a5d4a546ad21\" (UID: \"90ace907-c5e9-4596-917d-a5d4a546ad21\") "
Jul 14 02:09:44.709455 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.709386    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngqtg\" (UniqueName: \"kubernetes.io/projected/729913af-5015-4678-abb1-15b74734d779-kube-api-access-ngqtg\") pod \"729913af-5015-4678-abb1-15b74734d779\" (UID: \"729913af-5015-4678-abb1-15b74734d779\") "
Jul 14 02:09:44.709455 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.709440    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svspq\" (UniqueName: \"kubernetes.io/projected/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-kube-api-access-svspq\") pod \"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92\" (UID: \"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92\") "
Jul 14 02:09:44.709548 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.709512    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/392f2074-5af1-4066-be7d-87f972017981-bundle\") pod \"392f2074-5af1-4066-be7d-87f972017981\" (UID: \"392f2074-5af1-4066-be7d-87f972017981\") "
Jul 14 02:09:44.709548 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.709539    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-util\") pod \"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92\" (UID: \"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92\") "
Jul 14 02:09:44.709652 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.709573    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-bundle\") pod \"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92\" (UID: \"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92\") "
Jul 14 02:09:44.709652 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.709622    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/392f2074-5af1-4066-be7d-87f972017981-util\") pod \"392f2074-5af1-4066-be7d-87f972017981\" (UID: \"392f2074-5af1-4066-be7d-87f972017981\") "
Jul 14 02:09:44.709742 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.709652    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90ace907-c5e9-4596-917d-a5d4a546ad21-bundle\") pod \"90ace907-c5e9-4596-917d-a5d4a546ad21\" (UID: \"90ace907-c5e9-4596-917d-a5d4a546ad21\") "
Jul 14 02:09:44.711727 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.709928    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/729913af-5015-4678-abb1-15b74734d779-bundle" (OuterVolumeSpecName: "bundle") pod "729913af-5015-4678-abb1-15b74734d779" (UID: "729913af-5015-4678-abb1-15b74734d779"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:09:44.711727 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.710687    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-bundle" (OuterVolumeSpecName: "bundle") pod "fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92" (UID: "fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:09:44.711727 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.711256    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ace907-c5e9-4596-917d-a5d4a546ad21-bundle" (OuterVolumeSpecName: "bundle") pod "90ace907-c5e9-4596-917d-a5d4a546ad21" (UID: "90ace907-c5e9-4596-917d-a5d4a546ad21"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:09:44.712134 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.712106    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/729913af-5015-4678-abb1-15b74734d779-kube-api-access-ngqtg" (OuterVolumeSpecName: "kube-api-access-ngqtg") pod "729913af-5015-4678-abb1-15b74734d779" (UID: "729913af-5015-4678-abb1-15b74734d779"). InnerVolumeSpecName "kube-api-access-ngqtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:09:44.712300 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.712254    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/392f2074-5af1-4066-be7d-87f972017981-bundle" (OuterVolumeSpecName: "bundle") pod "392f2074-5af1-4066-be7d-87f972017981" (UID: "392f2074-5af1-4066-be7d-87f972017981"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:09:44.712526 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.712502    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/392f2074-5af1-4066-be7d-87f972017981-kube-api-access-sfkwb" (OuterVolumeSpecName: "kube-api-access-sfkwb") pod "392f2074-5af1-4066-be7d-87f972017981" (UID: "392f2074-5af1-4066-be7d-87f972017981"). InnerVolumeSpecName "kube-api-access-sfkwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:09:44.716149 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.713387    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90ace907-c5e9-4596-917d-a5d4a546ad21-kube-api-access-kg7jg" (OuterVolumeSpecName: "kube-api-access-kg7jg") pod "90ace907-c5e9-4596-917d-a5d4a546ad21" (UID: "90ace907-c5e9-4596-917d-a5d4a546ad21"). InnerVolumeSpecName "kube-api-access-kg7jg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:09:44.716149 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.714749    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-kube-api-access-svspq" (OuterVolumeSpecName: "kube-api-access-svspq") pod "fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92" (UID: "fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92"). InnerVolumeSpecName "kube-api-access-svspq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:09:44.717732 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.717700    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/729913af-5015-4678-abb1-15b74734d779-util" (OuterVolumeSpecName: "util") pod "729913af-5015-4678-abb1-15b74734d779" (UID: "729913af-5015-4678-abb1-15b74734d779"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:09:44.719207 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.719156    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/392f2074-5af1-4066-be7d-87f972017981-util" (OuterVolumeSpecName: "util") pod "392f2074-5af1-4066-be7d-87f972017981" (UID: "392f2074-5af1-4066-be7d-87f972017981"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:09:44.720134 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.720083    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-util" (OuterVolumeSpecName: "util") pod "fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92" (UID: "fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:09:44.774904 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.774860    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90ace907-c5e9-4596-917d-a5d4a546ad21-util" (OuterVolumeSpecName: "util") pod "90ace907-c5e9-4596-917d-a5d4a546ad21" (UID: "90ace907-c5e9-4596-917d-a5d4a546ad21"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:09:44.810660 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.810618    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngqtg\" (UniqueName: \"kubernetes.io/projected/729913af-5015-4678-abb1-15b74734d779-kube-api-access-ngqtg\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:09:44.810660 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.810652    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svspq\" (UniqueName: \"kubernetes.io/projected/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-kube-api-access-svspq\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:09:44.810660 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.810661    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/392f2074-5af1-4066-be7d-87f972017981-bundle\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:09:44.810660 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.810670    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-util\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:09:44.810916 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.810678    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92-bundle\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:09:44.810916 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.810685    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/392f2074-5af1-4066-be7d-87f972017981-util\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:09:44.810916 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.810693    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90ace907-c5e9-4596-917d-a5d4a546ad21-bundle\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:09:44.810916 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.810700    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/729913af-5015-4678-abb1-15b74734d779-util\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:09:44.810916 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.810708    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/729913af-5015-4678-abb1-15b74734d779-bundle\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:09:44.810916 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.810714    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90ace907-c5e9-4596-917d-a5d4a546ad21-util\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:09:44.810916 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.810722    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfkwb\" (UniqueName: \"kubernetes.io/projected/392f2074-5af1-4066-be7d-87f972017981-kube-api-access-sfkwb\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:09:44.810916 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:44.810731    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg7jg\" (UniqueName: \"kubernetes.io/projected/90ace907-c5e9-4596-917d-a5d4a546ad21-kube-api-access-kg7jg\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:09:45.459478 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:45.459445    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc"
Jul 14 02:09:45.459644 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:45.459443    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc" event={"ID":"fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92","Type":"ContainerDied","Data":"4668394cc97ec88a30f190f8b3f5414173bdcfaf54b5c4fa3065f26908c53fd2"}
Jul 14 02:09:45.459644 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:45.459570    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4668394cc97ec88a30f190f8b3f5414173bdcfaf54b5c4fa3065f26908c53fd2"
Jul 14 02:09:45.461527 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:45.461502    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb"
Jul 14 02:09:45.461646 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:45.461493    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb" event={"ID":"90ace907-c5e9-4596-917d-a5d4a546ad21","Type":"ContainerDied","Data":"c8d17c9b339f102a573e9c1698807bd56b92c6f78f9946e204bc79472fa0ef04"}
Jul 14 02:09:45.461646 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:45.461620    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8d17c9b339f102a573e9c1698807bd56b92c6f78f9946e204bc79472fa0ef04"
Jul 14 02:09:45.463493 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:45.463472    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88"
Jul 14 02:09:45.463593 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:45.463494    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88" event={"ID":"729913af-5015-4678-abb1-15b74734d779","Type":"ContainerDied","Data":"9c98d20064e01e51e9c82000cf359ac50131ad8a105a4549a36644e376f6259a"}
Jul 14 02:09:45.463593 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:45.463536    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c98d20064e01e51e9c82000cf359ac50131ad8a105a4549a36644e376f6259a"
Jul 14 02:09:45.465502 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:45.465478    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s"
Jul 14 02:09:45.465502 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:45.465487    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s" event={"ID":"392f2074-5af1-4066-be7d-87f972017981","Type":"ContainerDied","Data":"720f194b741896317eade495cd0e048a6aa165145005ff7d8a9d15d669b602a3"}
Jul 14 02:09:45.465650 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:09:45.465520    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="720f194b741896317eade495cd0e048a6aa165145005ff7d8a9d15d669b602a3"
Jul 14 02:10:04.483220 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.483135    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fdbdc75d8-42j2f" podUID="a2d6c3ef-9708-4791-b265-b894afd8a851" containerName="console" containerID="cri-o://855e97d90d08fb62858a673c9c4845378cb80fd6fdf61aeb62ee09b6eb07dfec" gracePeriod=15
Jul 14 02:10:04.741044 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.740969    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:10:04.786857 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.786814    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2d6c3ef-9708-4791-b265-b894afd8a851-console-serving-cert\") pod \"a2d6c3ef-9708-4791-b265-b894afd8a851\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") "
Jul 14 02:10:04.786857 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.786867    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-trusted-ca-bundle\") pod \"a2d6c3ef-9708-4791-b265-b894afd8a851\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") "
Jul 14 02:10:04.787128 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.786905    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-service-ca\") pod \"a2d6c3ef-9708-4791-b265-b894afd8a851\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") "
Jul 14 02:10:04.787128 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.786992    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfpsd\" (UniqueName: \"kubernetes.io/projected/a2d6c3ef-9708-4791-b265-b894afd8a851-kube-api-access-hfpsd\") pod \"a2d6c3ef-9708-4791-b265-b894afd8a851\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") "
Jul 14 02:10:04.787128 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.787026    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2d6c3ef-9708-4791-b265-b894afd8a851-console-oauth-config\") pod \"a2d6c3ef-9708-4791-b265-b894afd8a851\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") "
Jul 14 02:10:04.787128 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.787055    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-console-config\") pod \"a2d6c3ef-9708-4791-b265-b894afd8a851\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") "
Jul 14 02:10:04.787128 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.787095    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-oauth-serving-cert\") pod \"a2d6c3ef-9708-4791-b265-b894afd8a851\" (UID: \"a2d6c3ef-9708-4791-b265-b894afd8a851\") "
Jul 14 02:10:04.787398 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.787311    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-service-ca" (OuterVolumeSpecName: "service-ca") pod "a2d6c3ef-9708-4791-b265-b894afd8a851" (UID: "a2d6c3ef-9708-4791-b265-b894afd8a851"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:10:04.787398 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.787341    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a2d6c3ef-9708-4791-b265-b894afd8a851" (UID: "a2d6c3ef-9708-4791-b265-b894afd8a851"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:10:04.787611 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.787591    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-console-config" (OuterVolumeSpecName: "console-config") pod "a2d6c3ef-9708-4791-b265-b894afd8a851" (UID: "a2d6c3ef-9708-4791-b265-b894afd8a851"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:10:04.787662 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.787614    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:10:04.787662 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.787637    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-trusted-ca-bundle\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:10:04.787724 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.787698    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a2d6c3ef-9708-4791-b265-b894afd8a851" (UID: "a2d6c3ef-9708-4791-b265-b894afd8a851"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:10:04.789232 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.789196    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2d6c3ef-9708-4791-b265-b894afd8a851-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a2d6c3ef-9708-4791-b265-b894afd8a851" (UID: "a2d6c3ef-9708-4791-b265-b894afd8a851"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:10:04.789331 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.789242    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2d6c3ef-9708-4791-b265-b894afd8a851-kube-api-access-hfpsd" (OuterVolumeSpecName: "kube-api-access-hfpsd") pod "a2d6c3ef-9708-4791-b265-b894afd8a851" (UID: "a2d6c3ef-9708-4791-b265-b894afd8a851"). InnerVolumeSpecName "kube-api-access-hfpsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:10:04.789473 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.789443    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2d6c3ef-9708-4791-b265-b894afd8a851-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a2d6c3ef-9708-4791-b265-b894afd8a851" (UID: "a2d6c3ef-9708-4791-b265-b894afd8a851"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:10:04.888126 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.888083    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2d6c3ef-9708-4791-b265-b894afd8a851-console-serving-cert\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:10:04.888126 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.888119    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfpsd\" (UniqueName: \"kubernetes.io/projected/a2d6c3ef-9708-4791-b265-b894afd8a851-kube-api-access-hfpsd\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:10:04.888126 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.888129    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2d6c3ef-9708-4791-b265-b894afd8a851-console-oauth-config\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:10:04.888126 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.888138    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-console-config\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:10:04.888420 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:04.888148    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2d6c3ef-9708-4791-b265-b894afd8a851-oauth-serving-cert\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:10:05.575037 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:05.574999    2563 generic.go:356] "Generic (PLEG): container finished" podID="a2d6c3ef-9708-4791-b265-b894afd8a851" containerID="855e97d90d08fb62858a673c9c4845378cb80fd6fdf61aeb62ee09b6eb07dfec" exitCode=0
Jul 14 02:10:05.575476 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:05.575041    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fdbdc75d8-42j2f"
Jul 14 02:10:05.575476 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:05.575053    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdbdc75d8-42j2f" event={"ID":"a2d6c3ef-9708-4791-b265-b894afd8a851","Type":"ContainerDied","Data":"855e97d90d08fb62858a673c9c4845378cb80fd6fdf61aeb62ee09b6eb07dfec"}
Jul 14 02:10:05.575476 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:05.575101    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fdbdc75d8-42j2f" event={"ID":"a2d6c3ef-9708-4791-b265-b894afd8a851","Type":"ContainerDied","Data":"f6f95854d7bbbb2126260b6535192a64387da8a3b1a2eb7ab1d59309073e61bf"}
Jul 14 02:10:05.575476 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:05.575122    2563 scope.go:117] "RemoveContainer" containerID="855e97d90d08fb62858a673c9c4845378cb80fd6fdf61aeb62ee09b6eb07dfec"
Jul 14 02:10:05.590831 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:05.590808    2563 scope.go:117] "RemoveContainer" containerID="855e97d90d08fb62858a673c9c4845378cb80fd6fdf61aeb62ee09b6eb07dfec"
Jul 14 02:10:05.591155 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:10:05.591133    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"855e97d90d08fb62858a673c9c4845378cb80fd6fdf61aeb62ee09b6eb07dfec\": container with ID starting with 855e97d90d08fb62858a673c9c4845378cb80fd6fdf61aeb62ee09b6eb07dfec not found: ID does not exist" containerID="855e97d90d08fb62858a673c9c4845378cb80fd6fdf61aeb62ee09b6eb07dfec"
Jul 14 02:10:05.591220 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:05.591187    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855e97d90d08fb62858a673c9c4845378cb80fd6fdf61aeb62ee09b6eb07dfec"} err="failed to get container status \"855e97d90d08fb62858a673c9c4845378cb80fd6fdf61aeb62ee09b6eb07dfec\": rpc error: code = NotFound desc = could not find container \"855e97d90d08fb62858a673c9c4845378cb80fd6fdf61aeb62ee09b6eb07dfec\": container with ID starting with 855e97d90d08fb62858a673c9c4845378cb80fd6fdf61aeb62ee09b6eb07dfec not found: ID does not exist"
Jul 14 02:10:05.601108 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:05.601079    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fdbdc75d8-42j2f"]
Jul 14 02:10:05.605259 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:05.605235    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fdbdc75d8-42j2f"]
Jul 14 02:10:05.856183 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:05.856088    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2d6c3ef-9708-4791-b265-b894afd8a851" path="/var/lib/kubelet/pods/a2d6c3ef-9708-4791-b265-b894afd8a851/volumes"
Jul 14 02:10:16.280286 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280196    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d"]
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280601    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="729913af-5015-4678-abb1-15b74734d779" containerName="util"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280614    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="729913af-5015-4678-abb1-15b74734d779" containerName="util"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280626    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392f2074-5af1-4066-be7d-87f972017981" containerName="util"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280631    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="392f2074-5af1-4066-be7d-87f972017981" containerName="util"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280637    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90ace907-c5e9-4596-917d-a5d4a546ad21" containerName="extract"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280645    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="90ace907-c5e9-4596-917d-a5d4a546ad21" containerName="extract"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280658    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90ace907-c5e9-4596-917d-a5d4a546ad21" containerName="util"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280663    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="90ace907-c5e9-4596-917d-a5d4a546ad21" containerName="util"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280668    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92" containerName="pull"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280673    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92" containerName="pull"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280686    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92" containerName="util"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280691    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92" containerName="util"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280701    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2d6c3ef-9708-4791-b265-b894afd8a851" containerName="console"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280707    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2d6c3ef-9708-4791-b265-b894afd8a851" containerName="console"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280714    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90ace907-c5e9-4596-917d-a5d4a546ad21" containerName="pull"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280719    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="90ace907-c5e9-4596-917d-a5d4a546ad21" containerName="pull"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280726    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392f2074-5af1-4066-be7d-87f972017981" containerName="extract"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280731    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="392f2074-5af1-4066-be7d-87f972017981" containerName="extract"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280738    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392f2074-5af1-4066-be7d-87f972017981" containerName="pull"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280743    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="392f2074-5af1-4066-be7d-87f972017981" containerName="pull"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280749    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="729913af-5015-4678-abb1-15b74734d779" containerName="extract"
Jul 14 02:10:16.280737 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280754    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="729913af-5015-4678-abb1-15b74734d779" containerName="extract"
Jul 14 02:10:16.281485 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280759    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92" containerName="extract"
Jul 14 02:10:16.281485 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280764    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92" containerName="extract"
Jul 14 02:10:16.281485 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280770    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="729913af-5015-4678-abb1-15b74734d779" containerName="pull"
Jul 14 02:10:16.281485 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280774    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="729913af-5015-4678-abb1-15b74734d779" containerName="pull"
Jul 14 02:10:16.281485 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280831    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92" containerName="extract"
Jul 14 02:10:16.281485 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280838    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="90ace907-c5e9-4596-917d-a5d4a546ad21" containerName="extract"
Jul 14 02:10:16.281485 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280844    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2d6c3ef-9708-4791-b265-b894afd8a851" containerName="console"
Jul 14 02:10:16.281485 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280849    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="392f2074-5af1-4066-be7d-87f972017981" containerName="extract"
Jul 14 02:10:16.281485 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.280858    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="729913af-5015-4678-abb1-15b74734d779" containerName="extract"
Jul 14 02:10:16.283893 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.283869    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d"
Jul 14 02:10:16.286582 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.286559    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 14 02:10:16.286718 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.286588    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 02:10:16.287703 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.287681    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ggm5q\""
Jul 14 02:10:16.287826 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.287738    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 02:10:16.287826 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.287750    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 14 02:10:16.292982 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.292948    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d"]
Jul 14 02:10:16.398344 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.398303    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrhqg\" (UniqueName: \"kubernetes.io/projected/2aa3164b-a1fb-4963-880a-c136f37c7850-kube-api-access-wrhqg\") pod \"kuadrant-console-plugin-66b5774985-9l57d\" (UID: \"2aa3164b-a1fb-4963-880a-c136f37c7850\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d"
Jul 14 02:10:16.398523 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.398404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2aa3164b-a1fb-4963-880a-c136f37c7850-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9l57d\" (UID: \"2aa3164b-a1fb-4963-880a-c136f37c7850\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d"
Jul 14 02:10:16.398523 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.398434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aa3164b-a1fb-4963-880a-c136f37c7850-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9l57d\" (UID: \"2aa3164b-a1fb-4963-880a-c136f37c7850\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d"
Jul 14 02:10:16.499607 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.499572    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aa3164b-a1fb-4963-880a-c136f37c7850-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9l57d\" (UID: \"2aa3164b-a1fb-4963-880a-c136f37c7850\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d"
Jul 14 02:10:16.499768 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.499743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrhqg\" (UniqueName: \"kubernetes.io/projected/2aa3164b-a1fb-4963-880a-c136f37c7850-kube-api-access-wrhqg\") pod \"kuadrant-console-plugin-66b5774985-9l57d\" (UID: \"2aa3164b-a1fb-4963-880a-c136f37c7850\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d"
Jul 14 02:10:16.499873 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.499856    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2aa3164b-a1fb-4963-880a-c136f37c7850-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9l57d\" (UID: \"2aa3164b-a1fb-4963-880a-c136f37c7850\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d"
Jul 14 02:10:16.500503 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.500485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2aa3164b-a1fb-4963-880a-c136f37c7850-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9l57d\" (UID: \"2aa3164b-a1fb-4963-880a-c136f37c7850\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d"
Jul 14 02:10:16.502115 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.502097    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aa3164b-a1fb-4963-880a-c136f37c7850-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9l57d\" (UID: \"2aa3164b-a1fb-4963-880a-c136f37c7850\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d"
Jul 14 02:10:16.508833 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.508800    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrhqg\" (UniqueName: \"kubernetes.io/projected/2aa3164b-a1fb-4963-880a-c136f37c7850-kube-api-access-wrhqg\") pod \"kuadrant-console-plugin-66b5774985-9l57d\" (UID: \"2aa3164b-a1fb-4963-880a-c136f37c7850\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d"
Jul 14 02:10:16.595632 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.595598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d"
Jul 14 02:10:16.741372 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:16.741343    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d"]
Jul 14 02:10:16.742890 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:10:16.742861    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2aa3164b_a1fb_4963_880a_c136f37c7850.slice/crio-bb883a1620f21bbaac041c19efc17e0a8fbe723652ae1d32e2eb35888a45be73 WatchSource:0}: Error finding container bb883a1620f21bbaac041c19efc17e0a8fbe723652ae1d32e2eb35888a45be73: Status 404 returned error can't find the container with id bb883a1620f21bbaac041c19efc17e0a8fbe723652ae1d32e2eb35888a45be73
Jul 14 02:10:17.647534 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:17.647494    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d" event={"ID":"2aa3164b-a1fb-4963-880a-c136f37c7850","Type":"ContainerStarted","Data":"bb883a1620f21bbaac041c19efc17e0a8fbe723652ae1d32e2eb35888a45be73"}
Jul 14 02:10:39.803940 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:39.803901    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d" event={"ID":"2aa3164b-a1fb-4963-880a-c136f37c7850","Type":"ContainerStarted","Data":"e0de6f9e6782bdf193772ff4cf401d5f3c09d6d61ecf4632b97f5cd3eac2e170"}
Jul 14 02:10:39.821841 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:10:39.821784    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9l57d" podStartSLOduration=0.8778037 podStartE2EDuration="23.821765993s" totalImagesPullingTime="22.943962293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:10:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:10:39.820224333 +0000 UTC m=+560.502795165" watchObservedRunningTime="2026-07-14 02:10:39.821765993 +0000 UTC m=+560.504336830"
Jul 14 02:11:15.869808 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:15.869770    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:11:15.878643 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:15.878607    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-cn79h"
Jul 14 02:11:15.880971 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:15.880933    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:11:15.881328 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:15.881300    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 14 02:11:15.896845 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:15.896818    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:11:15.947561 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:15.947522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfbbz\" (UniqueName: \"kubernetes.io/projected/ad70e053-7228-4854-9303-bd9be426197a-kube-api-access-sfbbz\") pod \"limitador-limitador-54d6d988d5-cn79h\" (UID: \"ad70e053-7228-4854-9303-bd9be426197a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cn79h"
Jul 14 02:11:15.947751 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:15.947584    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad70e053-7228-4854-9303-bd9be426197a-config-file\") pod \"limitador-limitador-54d6d988d5-cn79h\" (UID: \"ad70e053-7228-4854-9303-bd9be426197a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cn79h"
Jul 14 02:11:16.049040 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:16.048999    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad70e053-7228-4854-9303-bd9be426197a-config-file\") pod \"limitador-limitador-54d6d988d5-cn79h\" (UID: \"ad70e053-7228-4854-9303-bd9be426197a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cn79h"
Jul 14 02:11:16.049252 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:16.049094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfbbz\" (UniqueName: \"kubernetes.io/projected/ad70e053-7228-4854-9303-bd9be426197a-kube-api-access-sfbbz\") pod \"limitador-limitador-54d6d988d5-cn79h\" (UID: \"ad70e053-7228-4854-9303-bd9be426197a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cn79h"
Jul 14 02:11:16.049666 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:16.049642    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad70e053-7228-4854-9303-bd9be426197a-config-file\") pod \"limitador-limitador-54d6d988d5-cn79h\" (UID: \"ad70e053-7228-4854-9303-bd9be426197a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cn79h"
Jul 14 02:11:16.057002 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:16.056969    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfbbz\" (UniqueName: \"kubernetes.io/projected/ad70e053-7228-4854-9303-bd9be426197a-kube-api-access-sfbbz\") pod \"limitador-limitador-54d6d988d5-cn79h\" (UID: \"ad70e053-7228-4854-9303-bd9be426197a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cn79h"
Jul 14 02:11:16.190740 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:16.190648    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-cn79h"
Jul 14 02:11:16.329913 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:16.329886    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:11:16.332211 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:11:16.332154    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad70e053_7228_4854_9303_bd9be426197a.slice/crio-8b0962ff975c3607c261ad64fb80a0c61718f149452d9a8a15cdbf9a03bfb192 WatchSource:0}: Error finding container 8b0962ff975c3607c261ad64fb80a0c61718f149452d9a8a15cdbf9a03bfb192: Status 404 returned error can't find the container with id 8b0962ff975c3607c261ad64fb80a0c61718f149452d9a8a15cdbf9a03bfb192
Jul 14 02:11:16.418429 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:16.418398    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-w5s76"]
Jul 14 02:11:16.422123 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:16.422104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w5s76"
Jul 14 02:11:16.424503 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:16.424475    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5cd7c\""
Jul 14 02:11:16.428321 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:16.428294    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w5s76"]
Jul 14 02:11:16.453101 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:16.453005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cxl7\" (UniqueName: \"kubernetes.io/projected/d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861-kube-api-access-5cxl7\") pod \"authorino-75d556bd77-w5s76\" (UID: \"d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861\") " pod="kuadrant-system/authorino-75d556bd77-w5s76"
Jul 14 02:11:16.553962 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:16.553919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cxl7\" (UniqueName: \"kubernetes.io/projected/d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861-kube-api-access-5cxl7\") pod \"authorino-75d556bd77-w5s76\" (UID: \"d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861\") " pod="kuadrant-system/authorino-75d556bd77-w5s76"
Jul 14 02:11:16.561973 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:16.561948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cxl7\" (UniqueName: \"kubernetes.io/projected/d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861-kube-api-access-5cxl7\") pod \"authorino-75d556bd77-w5s76\" (UID: \"d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861\") " pod="kuadrant-system/authorino-75d556bd77-w5s76"
Jul 14 02:11:16.733331 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:16.733240    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w5s76"
Jul 14 02:11:16.922535 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:16.922489    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w5s76"]
Jul 14 02:11:16.927018 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:11:16.926984    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0e3f2fb_d7fa_48d6_9e9e_7fd09bd00861.slice/crio-21a21e0b5b0d76b5f6ddc46ae4e404f30b4cb43512806bd8883eab768a50c241 WatchSource:0}: Error finding container 21a21e0b5b0d76b5f6ddc46ae4e404f30b4cb43512806bd8883eab768a50c241: Status 404 returned error can't find the container with id 21a21e0b5b0d76b5f6ddc46ae4e404f30b4cb43512806bd8883eab768a50c241
Jul 14 02:11:17.009911 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:17.009749    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w5s76" event={"ID":"d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861","Type":"ContainerStarted","Data":"21a21e0b5b0d76b5f6ddc46ae4e404f30b4cb43512806bd8883eab768a50c241"}
Jul 14 02:11:17.013415 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:17.013325    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-cn79h" event={"ID":"ad70e053-7228-4854-9303-bd9be426197a","Type":"ContainerStarted","Data":"8b0962ff975c3607c261ad64fb80a0c61718f149452d9a8a15cdbf9a03bfb192"}
Jul 14 02:11:20.623791 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:20.623757    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:11:20.624772 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:20.624747    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:11:20.627775 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:20.627750    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:11:20.628477 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:20.628458    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:11:21.040596 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:21.040486    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w5s76" event={"ID":"d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861","Type":"ContainerStarted","Data":"fa8f78f0d8be603d12c1a240317dc31ae0d219c6771db740040368cfd1528ed7"}
Jul 14 02:11:21.042108 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:21.042068    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-cn79h" event={"ID":"ad70e053-7228-4854-9303-bd9be426197a","Type":"ContainerStarted","Data":"41dac201ac917cafc7cd4523d0f5d0daba1a668579eee1c9d7ddc19e5d76787a"}
Jul 14 02:11:21.042254 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:21.042151    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-cn79h"
Jul 14 02:11:21.055824 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:21.055768    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-w5s76" podStartSLOduration=1.338820771 podStartE2EDuration="5.055749705s" totalImagesPullingTime="3.716928934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:11:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:11:21.054345479 +0000 UTC m=+601.736916320" watchObservedRunningTime="2026-07-14 02:11:21.055749705 +0000 UTC m=+601.738320595"
Jul 14 02:11:21.076501 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:21.076449    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-cn79h" podStartSLOduration=1.7705050089999999 podStartE2EDuration="6.07643105s" totalImagesPullingTime="4.305926041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:11:21.073908958 +0000 UTC m=+601.756479831" watchObservedRunningTime="2026-07-14 02:11:21.07643105 +0000 UTC m=+601.759001887"
Jul 14 02:11:32.049078 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:32.049046    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-cn79h"
Jul 14 02:11:50.078793 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:50.078708    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w5s76"]
Jul 14 02:11:50.079222 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:50.078980    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-w5s76" podUID="d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861" containerName="authorino" containerID="cri-o://fa8f78f0d8be603d12c1a240317dc31ae0d219c6771db740040368cfd1528ed7" gracePeriod=30
Jul 14 02:11:50.207027 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:50.206993    2563 generic.go:356] "Generic (PLEG): container finished" podID="d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861" containerID="fa8f78f0d8be603d12c1a240317dc31ae0d219c6771db740040368cfd1528ed7" exitCode=0
Jul 14 02:11:50.207242 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:50.207068    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w5s76" event={"ID":"d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861","Type":"ContainerDied","Data":"fa8f78f0d8be603d12c1a240317dc31ae0d219c6771db740040368cfd1528ed7"}
Jul 14 02:11:50.340825 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:50.340758    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w5s76"
Jul 14 02:11:50.474137 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:50.474092    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cxl7\" (UniqueName: \"kubernetes.io/projected/d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861-kube-api-access-5cxl7\") pod \"d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861\" (UID: \"d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861\") "
Jul 14 02:11:50.476289 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:50.476251    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861-kube-api-access-5cxl7" (OuterVolumeSpecName: "kube-api-access-5cxl7") pod "d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861" (UID: "d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861"). InnerVolumeSpecName "kube-api-access-5cxl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:11:50.575875 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:50.575839    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cxl7\" (UniqueName: \"kubernetes.io/projected/d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861-kube-api-access-5cxl7\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:11:51.213982 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:51.213952    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w5s76"
Jul 14 02:11:51.214433 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:51.213989    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w5s76" event={"ID":"d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861","Type":"ContainerDied","Data":"21a21e0b5b0d76b5f6ddc46ae4e404f30b4cb43512806bd8883eab768a50c241"}
Jul 14 02:11:51.214433 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:51.214050    2563 scope.go:117] "RemoveContainer" containerID="fa8f78f0d8be603d12c1a240317dc31ae0d219c6771db740040368cfd1528ed7"
Jul 14 02:11:51.234637 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:51.234608    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w5s76"]
Jul 14 02:11:51.240963 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:51.240938    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w5s76"]
Jul 14 02:11:51.855104 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:11:51.855070    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861" path="/var/lib/kubelet/pods/d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861/volumes"
Jul 14 02:12:31.575957 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:12:31.575924    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:12:53.685521 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:12:53.685475    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:13:09.083073 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:13:09.083038    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:13:17.482126 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:13:17.482040    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:13:46.584805 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:13:46.584767    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:13:59.690990 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:13:59.690951    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:14:21.795429 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:14:21.795388    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:15:00.140200 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:00.140150    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733255-cr9pf"]
Jul 14 02:15:00.140673 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:00.140551    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861" containerName="authorino"
Jul 14 02:15:00.140673 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:00.140562    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861" containerName="authorino"
Jul 14 02:15:00.140673 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:00.140639    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0e3f2fb-d7fa-48d6-9e9e-7fd09bd00861" containerName="authorino"
Jul 14 02:15:00.142763 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:00.142744    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733255-cr9pf"
Jul 14 02:15:00.145296 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:00.145274    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:15:00.150373 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:00.150344    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733255-cr9pf"]
Jul 14 02:15:00.154926 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:00.154900    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733255-cr9pf"
Jul 14 02:15:00.293259 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:00.293233    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733255-cr9pf"]
Jul 14 02:15:00.294981 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:15:00.294950    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc35534_9be6_4033_a0f7_e12eea54ef79.slice/crio-d2198cde599253b8df8d416266401114d02dc21c323e1d802d30a0d88978ac43 WatchSource:0}: Error finding container d2198cde599253b8df8d416266401114d02dc21c323e1d802d30a0d88978ac43: Status 404 returned error can't find the container with id d2198cde599253b8df8d416266401114d02dc21c323e1d802d30a0d88978ac43
Jul 14 02:15:00.296864 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:00.296849    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 02:15:01.244557 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:01.244514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733255-cr9pf" event={"ID":"3dc35534-9be6-4033-a0f7-e12eea54ef79","Type":"ContainerStarted","Data":"d2198cde599253b8df8d416266401114d02dc21c323e1d802d30a0d88978ac43"}
Jul 14 02:15:04.263816 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:04.263768    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733255-cr9pf" event={"ID":"3dc35534-9be6-4033-a0f7-e12eea54ef79","Type":"ContainerStarted","Data":"da7f2f756bd90ccc4a80cc06ae78e6dc4a189389a4f8bbd885f92601b5e380c1"}
Jul 14 02:15:04.279824 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:04.279767    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733255-cr9pf" podStartSLOduration=1.194015946 podStartE2EDuration="4.279749428s" totalImagesPullingTime="3.085733482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:15:04.2777702 +0000 UTC m=+824.960341057" watchObservedRunningTime="2026-07-14 02:15:04.279749428 +0000 UTC m=+824.962320264"
Jul 14 02:15:05.271239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:05.271200    2563 generic.go:356] "Generic (PLEG): container finished" podID="3dc35534-9be6-4033-a0f7-e12eea54ef79" containerID="da7f2f756bd90ccc4a80cc06ae78e6dc4a189389a4f8bbd885f92601b5e380c1" exitCode=0
Jul 14 02:15:05.271650 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:05.271278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733255-cr9pf" event={"ID":"3dc35534-9be6-4033-a0f7-e12eea54ef79","Type":"ContainerDied","Data":"da7f2f756bd90ccc4a80cc06ae78e6dc4a189389a4f8bbd885f92601b5e380c1"}
Jul 14 02:15:06.410234 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:06.410206    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733255-cr9pf"
Jul 14 02:15:07.282501 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:07.282470    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733255-cr9pf"
Jul 14 02:15:07.282681 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:07.282471    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733255-cr9pf" event={"ID":"3dc35534-9be6-4033-a0f7-e12eea54ef79","Type":"ContainerDied","Data":"d2198cde599253b8df8d416266401114d02dc21c323e1d802d30a0d88978ac43"}
Jul 14 02:15:07.282681 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:07.282594    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2198cde599253b8df8d416266401114d02dc21c323e1d802d30a0d88978ac43"
Jul 14 02:15:25.350266 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.350220    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-ffb6789c8-wr5qt"]
Jul 14 02:15:25.350667 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.350626    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dc35534-9be6-4033-a0f7-e12eea54ef79" containerName="cleanup"
Jul 14 02:15:25.350667 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.350639    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dc35534-9be6-4033-a0f7-e12eea54ef79" containerName="cleanup"
Jul 14 02:15:25.350742 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.350696    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dc35534-9be6-4033-a0f7-e12eea54ef79" containerName="cleanup"
Jul 14 02:15:25.358269 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.358239    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ffb6789c8-wr5qt"
Jul 14 02:15:25.361837 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.361808    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 14 02:15:25.362029 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.361808    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5cd7c\""
Jul 14 02:15:25.362659 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.362629    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-ffb6789c8-wr5qt"]
Jul 14 02:15:25.394621 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.394583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8crzw\" (UniqueName: \"kubernetes.io/projected/01b26d5e-265a-4ce1-aaea-d27c20121657-kube-api-access-8crzw\") pod \"authorino-ffb6789c8-wr5qt\" (UID: \"01b26d5e-265a-4ce1-aaea-d27c20121657\") " pod="kuadrant-system/authorino-ffb6789c8-wr5qt"
Jul 14 02:15:25.394621 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.394622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/01b26d5e-265a-4ce1-aaea-d27c20121657-tls-cert\") pod \"authorino-ffb6789c8-wr5qt\" (UID: \"01b26d5e-265a-4ce1-aaea-d27c20121657\") " pod="kuadrant-system/authorino-ffb6789c8-wr5qt"
Jul 14 02:15:25.495371 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.495332    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8crzw\" (UniqueName: \"kubernetes.io/projected/01b26d5e-265a-4ce1-aaea-d27c20121657-kube-api-access-8crzw\") pod \"authorino-ffb6789c8-wr5qt\" (UID: \"01b26d5e-265a-4ce1-aaea-d27c20121657\") " pod="kuadrant-system/authorino-ffb6789c8-wr5qt"
Jul 14 02:15:25.495371 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.495374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/01b26d5e-265a-4ce1-aaea-d27c20121657-tls-cert\") pod \"authorino-ffb6789c8-wr5qt\" (UID: \"01b26d5e-265a-4ce1-aaea-d27c20121657\") " pod="kuadrant-system/authorino-ffb6789c8-wr5qt"
Jul 14 02:15:25.497853 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.497821    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/01b26d5e-265a-4ce1-aaea-d27c20121657-tls-cert\") pod \"authorino-ffb6789c8-wr5qt\" (UID: \"01b26d5e-265a-4ce1-aaea-d27c20121657\") " pod="kuadrant-system/authorino-ffb6789c8-wr5qt"
Jul 14 02:15:25.503448 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.503425    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8crzw\" (UniqueName: \"kubernetes.io/projected/01b26d5e-265a-4ce1-aaea-d27c20121657-kube-api-access-8crzw\") pod \"authorino-ffb6789c8-wr5qt\" (UID: \"01b26d5e-265a-4ce1-aaea-d27c20121657\") " pod="kuadrant-system/authorino-ffb6789c8-wr5qt"
Jul 14 02:15:25.671048 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.670959    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-ffb6789c8-wr5qt"
Jul 14 02:15:25.819934 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:25.816967    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-ffb6789c8-wr5qt"]
Jul 14 02:15:26.395463 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:26.395399    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ffb6789c8-wr5qt" event={"ID":"01b26d5e-265a-4ce1-aaea-d27c20121657","Type":"ContainerStarted","Data":"ef9ffb850f48e803d532bbd8441c4edbff9339ab1c21384e3d78c0977d2bab00"}
Jul 14 02:15:26.395463 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:26.395454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-ffb6789c8-wr5qt" event={"ID":"01b26d5e-265a-4ce1-aaea-d27c20121657","Type":"ContainerStarted","Data":"884ebe9b4fe7ad25cf24b67b0fc6f8bfc8d05fbf47bc71d58aa2cced3a7d5e46"}
Jul 14 02:15:26.414445 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:26.414366    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-ffb6789c8-wr5qt" podStartSLOduration=0.962280485 podStartE2EDuration="1.414340082s" totalImagesPullingTime="452.059597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:15:26.411142476 +0000 UTC m=+847.093713314" watchObservedRunningTime="2026-07-14 02:15:26.414340082 +0000 UTC m=+847.096910920"
Jul 14 02:15:53.895488 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:15:53.895441    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:16:04.296997 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:16:04.296959    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:16:16.088125 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:16:16.088044    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:16:20.665763 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:16:20.665735    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:16:20.668233 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:16:20.668205    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:16:20.669378 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:16:20.669355    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:16:20.671832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:16:20.671814    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:16:24.089619 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:16:24.089576    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:16:34.885550 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:16:34.885510    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:17:01.989242 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:17:01.989206    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:17:15.883879 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:17:15.883839    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:17:47.895984 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:17:47.895894    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:17:58.192455 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:17:58.192414    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:18:08.880456 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:18:08.880420    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:18:18.096826 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:18:18.096788    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:18:28.495055 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:18:28.495017    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:18:38.095680 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:18:38.095646    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:18:49.088089 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:18:49.088041    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:18:59.083322 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:18:59.083287    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:19:24.493362 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:19:24.493279    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:19:36.229068 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:19:36.229027    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:19:55.988932 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:19:55.988888    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:20:07.596359 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:20:07.596315    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:20:22.392056 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:20:22.392017    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:20:32.593071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:20:32.593029    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:20:51.084571 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:20:51.084483    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:21:07.296334 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:21:07.296296    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:21:20.706020 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:21:20.705987    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:21:20.709775 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:21:20.709743    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:21:20.710270 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:21:20.710247    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:21:20.714295 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:21:20.714268    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:22:49.886002 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:22:49.885963    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:22:59.691499 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:22:59.691451    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:23:10.482596 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:23:10.482546    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:23:21.688472 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:23:21.688429    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:23:33.585377 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:23:33.585340    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:23:43.188376 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:23:43.188282    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:23:51.487812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:23:51.487772    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:24:02.296605 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:24:02.296566    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:24:15.184203 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:24:15.184139    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:24:23.185424 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:24:23.185386    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:24:33.496680 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:24:33.496646    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:24:55.314490 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:24:55.314453    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:25:07.090435 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:25:07.090394    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:25:23.288256 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:25:23.288158    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:25:31.195255 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:25:31.195217    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:25:42.289474 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:25:42.289425    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:25:53.885703 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:25:53.885669    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:26:03.391814 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:26:03.391779    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:26:12.085146 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:26:12.085106    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:26:20.744046 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:26:20.744017    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:26:20.747712 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:26:20.747688    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:26:20.750525 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:26:20.750504    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:26:20.753894 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:26:20.753873    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:26:22.581227 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:26:22.581189    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:26:31.789643 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:26:31.789605    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:26:45.084444 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:26:45.084347    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:26:54.492393 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:26:54.492355    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:27:03.980359 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:27:03.980321    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:27:16.492039 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:27:16.492006    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:27:27.486698 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:27:27.486623    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:27:34.382204 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:27:34.382155    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:27:50.785007 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:27:50.784961    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:28:02.908831 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:02.908789    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:28:16.983351 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:16.983256    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:28:29.187794 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:29.187747    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:28:40.485777 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:40.485736    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:28:50.683431 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:50.683389    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:28:52.388773 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:52.388730    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t"]
Jul 14 02:28:52.392444 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:52.392417    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t"
Jul 14 02:28:52.396271 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:52.396244    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:28:52.396384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:52.396295    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:28:52.403271 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:52.403247    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t"]
Jul 14 02:28:52.526122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:52.526071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb0be389-c42d-470d-a4bd-a0b468803c59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4535243d-zqq6t\" (UID: \"fb0be389-c42d-470d-a4bd-a0b468803c59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t"
Jul 14 02:28:52.627333 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:52.627295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb0be389-c42d-470d-a4bd-a0b468803c59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4535243d-zqq6t\" (UID: \"fb0be389-c42d-470d-a4bd-a0b468803c59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t"
Jul 14 02:28:52.627910 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:52.627889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb0be389-c42d-470d-a4bd-a0b468803c59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4535243d-zqq6t\" (UID: \"fb0be389-c42d-470d-a4bd-a0b468803c59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t"
Jul 14 02:28:52.703647 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:52.703567    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t"
Jul 14 02:28:52.847195 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:52.847142    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t"]
Jul 14 02:28:52.849363 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:28:52.849330    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb0be389_c42d_470d_a4bd_a0b468803c59.slice/crio-3feec84f89a66406526bad5d372c1e418a983acf3c30e43b6b68ed66303db64c WatchSource:0}: Error finding container 3feec84f89a66406526bad5d372c1e418a983acf3c30e43b6b68ed66303db64c: Status 404 returned error can't find the container with id 3feec84f89a66406526bad5d372c1e418a983acf3c30e43b6b68ed66303db64c
Jul 14 02:28:52.883812 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:52.883771    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t" event={"ID":"fb0be389-c42d-470d-a4bd-a0b468803c59","Type":"ContainerStarted","Data":"3feec84f89a66406526bad5d372c1e418a983acf3c30e43b6b68ed66303db64c"}
Jul 14 02:28:53.891073 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:53.891038    2563 generic.go:356] "Generic (PLEG): container finished" podID="fb0be389-c42d-470d-a4bd-a0b468803c59" containerID="d710946ffec3c5a726e8fe3ecea68b8aab453fac78796940463dbe6d0e3e28b0" exitCode=7
Jul 14 02:28:53.891551 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:53.891112    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t" event={"ID":"fb0be389-c42d-470d-a4bd-a0b468803c59","Type":"ContainerDied","Data":"d710946ffec3c5a726e8fe3ecea68b8aab453fac78796940463dbe6d0e3e28b0"}
Jul 14 02:28:53.891551 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:53.891370    2563 scope.go:117] "RemoveContainer" containerID="d710946ffec3c5a726e8fe3ecea68b8aab453fac78796940463dbe6d0e3e28b0"
Jul 14 02:28:54.898027 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:54.897995    2563 generic.go:356] "Generic (PLEG): container finished" podID="fb0be389-c42d-470d-a4bd-a0b468803c59" containerID="bb0f3d2810e1f019824b6d348a64861ab39caeb50d002913966482555b586062" exitCode=7
Jul 14 02:28:54.898433 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:54.898053    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t" event={"ID":"fb0be389-c42d-470d-a4bd-a0b468803c59","Type":"ContainerDied","Data":"bb0f3d2810e1f019824b6d348a64861ab39caeb50d002913966482555b586062"}
Jul 14 02:28:54.898433 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:54.898136    2563 scope.go:117] "RemoveContainer" containerID="d710946ffec3c5a726e8fe3ecea68b8aab453fac78796940463dbe6d0e3e28b0"
Jul 14 02:28:54.898433 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:54.898352    2563 scope.go:117] "RemoveContainer" containerID="bb0f3d2810e1f019824b6d348a64861ab39caeb50d002913966482555b586062"
Jul 14 02:28:54.898588 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:28:54.898568    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4535243d-zqq6t_odh-ai-gateway-infra(fb0be389-c42d-470d-a4bd-a0b468803c59)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t" podUID="fb0be389-c42d-470d-a4bd-a0b468803c59"
Jul 14 02:28:55.905367 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:28:55.905334    2563 scope.go:117] "RemoveContainer" containerID="bb0f3d2810e1f019824b6d348a64861ab39caeb50d002913966482555b586062"
Jul 14 02:28:55.905757 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:28:55.905547    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-4535243d-zqq6t_odh-ai-gateway-infra(fb0be389-c42d-470d-a4bd-a0b468803c59)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t" podUID="fb0be389-c42d-470d-a4bd-a0b468803c59"
Jul 14 02:29:07.849685 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:07.849646    2563 scope.go:117] "RemoveContainer" containerID="bb0f3d2810e1f019824b6d348a64861ab39caeb50d002913966482555b586062"
Jul 14 02:29:08.986739 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:08.986644    2563 generic.go:356] "Generic (PLEG): container finished" podID="fb0be389-c42d-470d-a4bd-a0b468803c59" containerID="cc7db16e1aeaa8b179ac34e65cd670e676649f566279db124685a9324e0e48fd" exitCode=0
Jul 14 02:29:08.986739 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:08.986720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t" event={"ID":"fb0be389-c42d-470d-a4bd-a0b468803c59","Type":"ContainerDied","Data":"cc7db16e1aeaa8b179ac34e65cd670e676649f566279db124685a9324e0e48fd"}
Jul 14 02:29:08.987203 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:08.986792    2563 scope.go:117] "RemoveContainer" containerID="bb0f3d2810e1f019824b6d348a64861ab39caeb50d002913966482555b586062"
Jul 14 02:29:10.010662 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:10.010623    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t"]
Jul 14 02:29:10.135302 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:10.135277    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t"
Jul 14 02:29:10.293230 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:10.293140    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb0be389-c42d-470d-a4bd-a0b468803c59-maas-api-service-ca\") pod \"fb0be389-c42d-470d-a4bd-a0b468803c59\" (UID: \"fb0be389-c42d-470d-a4bd-a0b468803c59\") "
Jul 14 02:29:10.293481 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:10.293458    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb0be389-c42d-470d-a4bd-a0b468803c59-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fb0be389-c42d-470d-a4bd-a0b468803c59" (UID: "fb0be389-c42d-470d-a4bd-a0b468803c59"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:29:10.394348 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:10.394310    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb0be389-c42d-470d-a4bd-a0b468803c59-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:29:11.000895 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:11.000862    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t"
Jul 14 02:29:11.001115 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:11.000902    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t" event={"ID":"fb0be389-c42d-470d-a4bd-a0b468803c59","Type":"ContainerDied","Data":"3feec84f89a66406526bad5d372c1e418a983acf3c30e43b6b68ed66303db64c"}
Jul 14 02:29:11.001115 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:11.000954    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3feec84f89a66406526bad5d372c1e418a983acf3c30e43b6b68ed66303db64c"
Jul 14 02:29:11.029770 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:11.029726    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t"]
Jul 14 02:29:11.033403 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:11.033360    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-zqq6t"]
Jul 14 02:29:11.855187 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:11.855145    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb0be389-c42d-470d-a4bd-a0b468803c59" path="/var/lib/kubelet/pods/fb0be389-c42d-470d-a4bd-a0b468803c59/volumes"
Jul 14 02:29:42.419582 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.419489    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-trsd5"]
Jul 14 02:29:42.419968 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.419888    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb0be389-c42d-470d-a4bd-a0b468803c59" containerName="revoke-keys"
Jul 14 02:29:42.419968 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.419899    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb0be389-c42d-470d-a4bd-a0b468803c59" containerName="revoke-keys"
Jul 14 02:29:42.419968 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.419909    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb0be389-c42d-470d-a4bd-a0b468803c59" containerName="revoke-keys"
Jul 14 02:29:42.419968 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.419914    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb0be389-c42d-470d-a4bd-a0b468803c59" containerName="revoke-keys"
Jul 14 02:29:42.420101 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.419995    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb0be389-c42d-470d-a4bd-a0b468803c59" containerName="revoke-keys"
Jul 14 02:29:42.420101 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.420005    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb0be389-c42d-470d-a4bd-a0b468803c59" containerName="revoke-keys"
Jul 14 02:29:42.423008 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.422990    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-trsd5"
Jul 14 02:29:42.425545 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.425522    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:29:42.425726 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.425563    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:29:42.429928 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.429896    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-trsd5"]
Jul 14 02:29:42.492267 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.492227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc4db398-cb9f-4bc5-b781-0decab645e99-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4535243d-trsd5\" (UID: \"dc4db398-cb9f-4bc5-b781-0decab645e99\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-trsd5"
Jul 14 02:29:42.593527 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.593487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc4db398-cb9f-4bc5-b781-0decab645e99-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4535243d-trsd5\" (UID: \"dc4db398-cb9f-4bc5-b781-0decab645e99\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-trsd5"
Jul 14 02:29:42.594127 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.594103    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc4db398-cb9f-4bc5-b781-0decab645e99-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4535243d-trsd5\" (UID: \"dc4db398-cb9f-4bc5-b781-0decab645e99\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-trsd5"
Jul 14 02:29:42.735351 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.735261    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-trsd5"
Jul 14 02:29:42.871610 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:42.871579    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-trsd5"]
Jul 14 02:29:42.873499 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:29:42.873473    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc4db398_cb9f_4bc5_b781_0decab645e99.slice/crio-a602e006bd89dc5f44883cbb3ec3abd2a82fc6b920f10d9f59445bacc9652fd2 WatchSource:0}: Error finding container a602e006bd89dc5f44883cbb3ec3abd2a82fc6b920f10d9f59445bacc9652fd2: Status 404 returned error can't find the container with id a602e006bd89dc5f44883cbb3ec3abd2a82fc6b920f10d9f59445bacc9652fd2
Jul 14 02:29:43.185211 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:43.185157    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-trsd5" event={"ID":"dc4db398-cb9f-4bc5-b781-0decab645e99","Type":"ContainerStarted","Data":"317fb97e00e727bedbb200b649111ec240f965b3fcc08cb07d406a360c91f6b5"}
Jul 14 02:29:43.185419 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:43.185238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-trsd5" event={"ID":"dc4db398-cb9f-4bc5-b781-0decab645e99","Type":"ContainerStarted","Data":"a602e006bd89dc5f44883cbb3ec3abd2a82fc6b920f10d9f59445bacc9652fd2"}
Jul 14 02:29:43.201438 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:43.201384    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-trsd5" podStartSLOduration=1.201367713 podStartE2EDuration="1.201367713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:29:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:29:43.198717701 +0000 UTC m=+1703.881288538" watchObservedRunningTime="2026-07-14 02:29:43.201367713 +0000 UTC m=+1703.883938596"
Jul 14 02:29:44.192376 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:44.192339    2563 generic.go:356] "Generic (PLEG): container finished" podID="dc4db398-cb9f-4bc5-b781-0decab645e99" containerID="317fb97e00e727bedbb200b649111ec240f965b3fcc08cb07d406a360c91f6b5" exitCode=0
Jul 14 02:29:44.192755 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:44.192427    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-trsd5" event={"ID":"dc4db398-cb9f-4bc5-b781-0decab645e99","Type":"ContainerDied","Data":"317fb97e00e727bedbb200b649111ec240f965b3fcc08cb07d406a360c91f6b5"}
Jul 14 02:29:45.333577 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:45.333542    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-trsd5"
Jul 14 02:29:45.420809 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:45.420777    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc4db398-cb9f-4bc5-b781-0decab645e99-maas-api-service-ca\") pod \"dc4db398-cb9f-4bc5-b781-0decab645e99\" (UID: \"dc4db398-cb9f-4bc5-b781-0decab645e99\") "
Jul 14 02:29:45.421241 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:45.421219    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc4db398-cb9f-4bc5-b781-0decab645e99-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dc4db398-cb9f-4bc5-b781-0decab645e99" (UID: "dc4db398-cb9f-4bc5-b781-0decab645e99"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:29:45.522645 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:45.522551    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc4db398-cb9f-4bc5-b781-0decab645e99-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:29:46.203492 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:46.203410    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-trsd5"
Jul 14 02:29:46.203492 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:46.203451    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4535243d-trsd5" event={"ID":"dc4db398-cb9f-4bc5-b781-0decab645e99","Type":"ContainerDied","Data":"a602e006bd89dc5f44883cbb3ec3abd2a82fc6b920f10d9f59445bacc9652fd2"}
Jul 14 02:29:46.203686 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:46.203509    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a602e006bd89dc5f44883cbb3ec3abd2a82fc6b920f10d9f59445bacc9652fd2"
Jul 14 02:29:56.088158 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:29:56.088120    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:30:00.132948 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:00.132910    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733270-dmzx8"]
Jul 14 02:30:00.133360 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:00.133317    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb0be389-c42d-470d-a4bd-a0b468803c59" containerName="revoke-keys"
Jul 14 02:30:00.133360 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:00.133330    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb0be389-c42d-470d-a4bd-a0b468803c59" containerName="revoke-keys"
Jul 14 02:30:00.133360 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:00.133353    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc4db398-cb9f-4bc5-b781-0decab645e99" containerName="revoke-keys"
Jul 14 02:30:00.133360 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:00.133360    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc4db398-cb9f-4bc5-b781-0decab645e99" containerName="revoke-keys"
Jul 14 02:30:00.133498 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:00.133437    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb0be389-c42d-470d-a4bd-a0b468803c59" containerName="revoke-keys"
Jul 14 02:30:00.133498 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:00.133445    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc4db398-cb9f-4bc5-b781-0decab645e99" containerName="revoke-keys"
Jul 14 02:30:00.136546 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:00.136523    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733270-dmzx8"
Jul 14 02:30:00.139054 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:00.139017    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:30:00.142874 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:00.142842    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733270-dmzx8"]
Jul 14 02:30:00.148126 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:00.148101    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733270-dmzx8"
Jul 14 02:30:00.287259 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:00.287231    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733270-dmzx8"]
Jul 14 02:30:00.289612 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:30:00.289582    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd23b59ca_ca4f_4c55_97bc_71cbd286ee9b.slice/crio-92a482c620d4d7dc90f02ea991c463ebaa21eb4f00976a265fd52989228b1542 WatchSource:0}: Error finding container 92a482c620d4d7dc90f02ea991c463ebaa21eb4f00976a265fd52989228b1542: Status 404 returned error can't find the container with id 92a482c620d4d7dc90f02ea991c463ebaa21eb4f00976a265fd52989228b1542
Jul 14 02:30:01.288585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:01.288549    2563 generic.go:356] "Generic (PLEG): container finished" podID="d23b59ca-ca4f-4c55-97bc-71cbd286ee9b" containerID="fd64547b5a39829baed8ced9007302263847dd8c0dd12d423d2424d557c99d22" exitCode=0
Jul 14 02:30:01.288954 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:01.288639    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733270-dmzx8" event={"ID":"d23b59ca-ca4f-4c55-97bc-71cbd286ee9b","Type":"ContainerDied","Data":"fd64547b5a39829baed8ced9007302263847dd8c0dd12d423d2424d557c99d22"}
Jul 14 02:30:01.288954 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:01.288687    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733270-dmzx8" event={"ID":"d23b59ca-ca4f-4c55-97bc-71cbd286ee9b","Type":"ContainerStarted","Data":"92a482c620d4d7dc90f02ea991c463ebaa21eb4f00976a265fd52989228b1542"}
Jul 14 02:30:02.428954 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:02.428926    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733270-dmzx8"
Jul 14 02:30:03.301376 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:03.301343    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733270-dmzx8"
Jul 14 02:30:03.301376 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:03.301370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733270-dmzx8" event={"ID":"d23b59ca-ca4f-4c55-97bc-71cbd286ee9b","Type":"ContainerDied","Data":"92a482c620d4d7dc90f02ea991c463ebaa21eb4f00976a265fd52989228b1542"}
Jul 14 02:30:03.301587 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:03.301422    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92a482c620d4d7dc90f02ea991c463ebaa21eb4f00976a265fd52989228b1542"
Jul 14 02:30:14.029009 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:14.028964    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz"]
Jul 14 02:30:14.029575 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:14.029404    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d23b59ca-ca4f-4c55-97bc-71cbd286ee9b" containerName="cleanup"
Jul 14 02:30:14.029575 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:14.029417    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d23b59ca-ca4f-4c55-97bc-71cbd286ee9b" containerName="cleanup"
Jul 14 02:30:14.029575 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:14.029484    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d23b59ca-ca4f-4c55-97bc-71cbd286ee9b" containerName="cleanup"
Jul 14 02:30:14.032592 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:14.032567    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz"
Jul 14 02:30:14.036883 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:14.036851    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:30:14.037074 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:14.036880    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:30:14.042783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:14.042756    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz"]
Jul 14 02:30:14.077306 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:14.077255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a147088-9d72-4a78-820f-84207c994355-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz\" (UID: \"5a147088-9d72-4a78-820f-84207c994355\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz"
Jul 14 02:30:14.178563 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:14.178523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a147088-9d72-4a78-820f-84207c994355-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz\" (UID: \"5a147088-9d72-4a78-820f-84207c994355\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz"
Jul 14 02:30:14.179141 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:14.179119    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a147088-9d72-4a78-820f-84207c994355-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz\" (UID: \"5a147088-9d72-4a78-820f-84207c994355\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz"
Jul 14 02:30:14.345489 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:14.345452    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz"
Jul 14 02:30:14.486843 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:14.486816    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz"]
Jul 14 02:30:14.488309 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:30:14.488285    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a147088_9d72_4a78_820f_84207c994355.slice/crio-23c08c7c77d79df9b1d64ef0db9403ed95ec44553258cf13b10e8589a783b9c1 WatchSource:0}: Error finding container 23c08c7c77d79df9b1d64ef0db9403ed95ec44553258cf13b10e8589a783b9c1: Status 404 returned error can't find the container with id 23c08c7c77d79df9b1d64ef0db9403ed95ec44553258cf13b10e8589a783b9c1
Jul 14 02:30:15.373116 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:15.373011    2563 generic.go:356] "Generic (PLEG): container finished" podID="5a147088-9d72-4a78-820f-84207c994355" containerID="8bc1e8b798c7d9a1d4d14c2307d5ae7d9d6d2991ea68b026b8f67c37d8a1f777" exitCode=7
Jul 14 02:30:15.373116 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:15.373065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz" event={"ID":"5a147088-9d72-4a78-820f-84207c994355","Type":"ContainerDied","Data":"8bc1e8b798c7d9a1d4d14c2307d5ae7d9d6d2991ea68b026b8f67c37d8a1f777"}
Jul 14 02:30:15.373548 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:15.373123    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz" event={"ID":"5a147088-9d72-4a78-820f-84207c994355","Type":"ContainerStarted","Data":"23c08c7c77d79df9b1d64ef0db9403ed95ec44553258cf13b10e8589a783b9c1"}
Jul 14 02:30:15.373548 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:15.373347    2563 scope.go:117] "RemoveContainer" containerID="8bc1e8b798c7d9a1d4d14c2307d5ae7d9d6d2991ea68b026b8f67c37d8a1f777"
Jul 14 02:30:16.380817 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:16.380777    2563 generic.go:356] "Generic (PLEG): container finished" podID="5a147088-9d72-4a78-820f-84207c994355" containerID="554d609b4b60b2dec2e1eb3a106c435b12b8bf9d9b77854bc0a2e8ad10cb0fc0" exitCode=7
Jul 14 02:30:16.381341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:16.380859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz" event={"ID":"5a147088-9d72-4a78-820f-84207c994355","Type":"ContainerDied","Data":"554d609b4b60b2dec2e1eb3a106c435b12b8bf9d9b77854bc0a2e8ad10cb0fc0"}
Jul 14 02:30:16.381341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:16.380928    2563 scope.go:117] "RemoveContainer" containerID="8bc1e8b798c7d9a1d4d14c2307d5ae7d9d6d2991ea68b026b8f67c37d8a1f777"
Jul 14 02:30:16.381341 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:16.381161    2563 scope.go:117] "RemoveContainer" containerID="554d609b4b60b2dec2e1eb3a106c435b12b8bf9d9b77854bc0a2e8ad10cb0fc0"
Jul 14 02:30:16.381467 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:30:16.381443    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz_odh-ai-gateway-infra(5a147088-9d72-4a78-820f-84207c994355)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz" podUID="5a147088-9d72-4a78-820f-84207c994355"
Jul 14 02:30:17.389140 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:17.389102    2563 scope.go:117] "RemoveContainer" containerID="554d609b4b60b2dec2e1eb3a106c435b12b8bf9d9b77854bc0a2e8ad10cb0fc0"
Jul 14 02:30:17.389499 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:30:17.389391    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz_odh-ai-gateway-infra(5a147088-9d72-4a78-820f-84207c994355)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz" podUID="5a147088-9d72-4a78-820f-84207c994355"
Jul 14 02:30:17.687913 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:17.687816    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:30:30.849843 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:30.849803    2563 scope.go:117] "RemoveContainer" containerID="554d609b4b60b2dec2e1eb3a106c435b12b8bf9d9b77854bc0a2e8ad10cb0fc0"
Jul 14 02:30:31.469119 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:31.469014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz" event={"ID":"5a147088-9d72-4a78-820f-84207c994355","Type":"ContainerStarted","Data":"324974d018fa18e604a92a7ca9123c0c11be164e54766e8d5cc7f7a4970ea348"}
Jul 14 02:30:31.485248 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:31.485196    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz" podStartSLOduration=17.485179645 podStartE2EDuration="17.485179645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:30:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:30:31.482433082 +0000 UTC m=+1752.165003918" watchObservedRunningTime="2026-07-14 02:30:31.485179645 +0000 UTC m=+1752.167750476"
Jul 14 02:30:32.476725 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:32.476690    2563 generic.go:356] "Generic (PLEG): container finished" podID="5a147088-9d72-4a78-820f-84207c994355" containerID="324974d018fa18e604a92a7ca9123c0c11be164e54766e8d5cc7f7a4970ea348" exitCode=0
Jul 14 02:30:32.477149 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:32.476763    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz" event={"ID":"5a147088-9d72-4a78-820f-84207c994355","Type":"ContainerDied","Data":"324974d018fa18e604a92a7ca9123c0c11be164e54766e8d5cc7f7a4970ea348"}
Jul 14 02:30:32.477149 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:32.476826    2563 scope.go:117] "RemoveContainer" containerID="554d609b4b60b2dec2e1eb3a106c435b12b8bf9d9b77854bc0a2e8ad10cb0fc0"
Jul 14 02:30:32.492686 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:32.492660    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz"]
Jul 14 02:30:33.620963 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:33.620932    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz"
Jul 14 02:30:33.762520 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:33.762419    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a147088-9d72-4a78-820f-84207c994355-maas-api-service-ca\") pod \"5a147088-9d72-4a78-820f-84207c994355\" (UID: \"5a147088-9d72-4a78-820f-84207c994355\") "
Jul 14 02:30:33.762854 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:33.762831    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a147088-9d72-4a78-820f-84207c994355-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5a147088-9d72-4a78-820f-84207c994355" (UID: "5a147088-9d72-4a78-820f-84207c994355"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:30:33.863243 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:33.863219    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a147088-9d72-4a78-820f-84207c994355-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:30:34.490895 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:34.490866    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz"
Jul 14 02:30:34.491069 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:34.490913    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz" event={"ID":"5a147088-9d72-4a78-820f-84207c994355","Type":"ContainerDied","Data":"23c08c7c77d79df9b1d64ef0db9403ed95ec44553258cf13b10e8589a783b9c1"}
Jul 14 02:30:34.491069 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:34.490958    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23c08c7c77d79df9b1d64ef0db9403ed95ec44553258cf13b10e8589a783b9c1"
Jul 14 02:30:34.520671 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:34.520636    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz"]
Jul 14 02:30:34.526435 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:34.526404    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-7dfdz"]
Jul 14 02:30:35.855084 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:30:35.855046    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a147088-9d72-4a78-820f-84207c994355" path="/var/lib/kubelet/pods/5a147088-9d72-4a78-820f-84207c994355/volumes"
Jul 14 02:31:14.066240 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.066135    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk"]
Jul 14 02:31:14.066798 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.066783    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a147088-9d72-4a78-820f-84207c994355" containerName="revoke-keys"
Jul 14 02:31:14.066872 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.066807    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a147088-9d72-4a78-820f-84207c994355" containerName="revoke-keys"
Jul 14 02:31:14.066872 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.066855    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a147088-9d72-4a78-820f-84207c994355" containerName="revoke-keys"
Jul 14 02:31:14.066872 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.066865    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a147088-9d72-4a78-820f-84207c994355" containerName="revoke-keys"
Jul 14 02:31:14.067027 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.066964    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a147088-9d72-4a78-820f-84207c994355" containerName="revoke-keys"
Jul 14 02:31:14.067027 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.066980    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a147088-9d72-4a78-820f-84207c994355" containerName="revoke-keys"
Jul 14 02:31:14.067027 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.066988    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a147088-9d72-4a78-820f-84207c994355" containerName="revoke-keys"
Jul 14 02:31:14.070301 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.070278    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk"
Jul 14 02:31:14.072892 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.072868    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:31:14.073957 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.073930    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:31:14.077293 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.077269    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk"]
Jul 14 02:31:14.134554 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.134514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43b21a52-0671-48c7-b4ca-8b779ba79436-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk\" (UID: \"43b21a52-0671-48c7-b4ca-8b779ba79436\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk"
Jul 14 02:31:14.236056 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.236017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43b21a52-0671-48c7-b4ca-8b779ba79436-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk\" (UID: \"43b21a52-0671-48c7-b4ca-8b779ba79436\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk"
Jul 14 02:31:14.236734 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.236712    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43b21a52-0671-48c7-b4ca-8b779ba79436-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk\" (UID: \"43b21a52-0671-48c7-b4ca-8b779ba79436\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk"
Jul 14 02:31:14.382345 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.382231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk"
Jul 14 02:31:14.523587 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.523559    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk"]
Jul 14 02:31:14.525026 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:31:14.524989    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b21a52_0671_48c7_b4ca_8b779ba79436.slice/crio-2f207127c1ec98ec147f753a583eb28ca7480960e02d1cff279aeb9abc7c6089 WatchSource:0}: Error finding container 2f207127c1ec98ec147f753a583eb28ca7480960e02d1cff279aeb9abc7c6089: Status 404 returned error can't find the container with id 2f207127c1ec98ec147f753a583eb28ca7480960e02d1cff279aeb9abc7c6089
Jul 14 02:31:14.717523 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:14.717450    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk" event={"ID":"43b21a52-0671-48c7-b4ca-8b779ba79436","Type":"ContainerStarted","Data":"2f207127c1ec98ec147f753a583eb28ca7480960e02d1cff279aeb9abc7c6089"}
Jul 14 02:31:15.725153 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:15.725119    2563 generic.go:356] "Generic (PLEG): container finished" podID="43b21a52-0671-48c7-b4ca-8b779ba79436" containerID="7608bc62698db0f7384731ea40827e55366b512c7b44105da74fb2f0fb9a4a52" exitCode=0
Jul 14 02:31:15.725555 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:15.725211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk" event={"ID":"43b21a52-0671-48c7-b4ca-8b779ba79436","Type":"ContainerDied","Data":"7608bc62698db0f7384731ea40827e55366b512c7b44105da74fb2f0fb9a4a52"}
Jul 14 02:31:16.883802 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:16.883775    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk"
Jul 14 02:31:16.960557 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:16.960523    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43b21a52-0671-48c7-b4ca-8b779ba79436-maas-api-service-ca\") pod \"43b21a52-0671-48c7-b4ca-8b779ba79436\" (UID: \"43b21a52-0671-48c7-b4ca-8b779ba79436\") "
Jul 14 02:31:16.960929 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:16.960905    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43b21a52-0671-48c7-b4ca-8b779ba79436-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "43b21a52-0671-48c7-b4ca-8b779ba79436" (UID: "43b21a52-0671-48c7-b4ca-8b779ba79436"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:31:17.061787 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:17.061692    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43b21a52-0671-48c7-b4ca-8b779ba79436-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:31:17.083614 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:17.083565    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:31:17.737999 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:17.737963    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk"
Jul 14 02:31:17.737999 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:17.737993    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk" event={"ID":"43b21a52-0671-48c7-b4ca-8b779ba79436","Type":"ContainerDied","Data":"2f207127c1ec98ec147f753a583eb28ca7480960e02d1cff279aeb9abc7c6089"}
Jul 14 02:31:17.738214 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:17.738040    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f207127c1ec98ec147f753a583eb28ca7480960e02d1cff279aeb9abc7c6089"
Jul 14 02:31:20.785280 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:20.785249    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:31:20.789614 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:20.789578    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:31:20.794652 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:20.794628    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:31:20.798136 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:20.798116    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:31:30.284858 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:30.284813    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:31:31.967626 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:31.967586    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc"]
Jul 14 02:31:31.968025 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:31.968008    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a147088-9d72-4a78-820f-84207c994355" containerName="revoke-keys"
Jul 14 02:31:31.968025 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:31.968021    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a147088-9d72-4a78-820f-84207c994355" containerName="revoke-keys"
Jul 14 02:31:31.968097 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:31.968041    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43b21a52-0671-48c7-b4ca-8b779ba79436" containerName="revoke-keys"
Jul 14 02:31:31.968097 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:31.968047    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="43b21a52-0671-48c7-b4ca-8b779ba79436" containerName="revoke-keys"
Jul 14 02:31:31.968159 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:31.968124    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="43b21a52-0671-48c7-b4ca-8b779ba79436" containerName="revoke-keys"
Jul 14 02:31:31.971052 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:31.971033    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc"
Jul 14 02:31:31.973799 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:31.973756    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:31:31.974802 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:31.974780    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:31:31.978488 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:31.978462    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc"]
Jul 14 02:31:32.102325 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:32.102276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da8b91b5-922c-4c47-8f13-b2aff0132e48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc\" (UID: \"da8b91b5-922c-4c47-8f13-b2aff0132e48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc"
Jul 14 02:31:32.203080 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:32.203039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da8b91b5-922c-4c47-8f13-b2aff0132e48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc\" (UID: \"da8b91b5-922c-4c47-8f13-b2aff0132e48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc"
Jul 14 02:31:32.203772 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:32.203746    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da8b91b5-922c-4c47-8f13-b2aff0132e48-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc\" (UID: \"da8b91b5-922c-4c47-8f13-b2aff0132e48\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc"
Jul 14 02:31:32.283777 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:32.283683    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc"
Jul 14 02:31:32.420276 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:32.420243    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc"]
Jul 14 02:31:32.421662 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:31:32.421635    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8b91b5_922c_4c47_8f13_b2aff0132e48.slice/crio-fed03b15936c441137eaee842eeae46343f9facfdf6935b595ff86060695b728 WatchSource:0}: Error finding container fed03b15936c441137eaee842eeae46343f9facfdf6935b595ff86060695b728: Status 404 returned error can't find the container with id fed03b15936c441137eaee842eeae46343f9facfdf6935b595ff86060695b728
Jul 14 02:31:32.825158 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:32.825120    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc" event={"ID":"da8b91b5-922c-4c47-8f13-b2aff0132e48","Type":"ContainerStarted","Data":"8c2b400b43378aff8fb4de270e25294563ae957a0e7e5ae9580d407ed2a007dc"}
Jul 14 02:31:32.825351 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:32.825193    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc" event={"ID":"da8b91b5-922c-4c47-8f13-b2aff0132e48","Type":"ContainerStarted","Data":"fed03b15936c441137eaee842eeae46343f9facfdf6935b595ff86060695b728"}
Jul 14 02:31:32.839673 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:32.839615    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc" podStartSLOduration=1.839597907 podStartE2EDuration="1.839597907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:31:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:31:32.83850992 +0000 UTC m=+1813.521080778" watchObservedRunningTime="2026-07-14 02:31:32.839597907 +0000 UTC m=+1813.522168744"
Jul 14 02:31:33.832690 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:33.832654    2563 generic.go:356] "Generic (PLEG): container finished" podID="da8b91b5-922c-4c47-8f13-b2aff0132e48" containerID="8c2b400b43378aff8fb4de270e25294563ae957a0e7e5ae9580d407ed2a007dc" exitCode=7
Jul 14 02:31:33.833130 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:33.832737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc" event={"ID":"da8b91b5-922c-4c47-8f13-b2aff0132e48","Type":"ContainerDied","Data":"8c2b400b43378aff8fb4de270e25294563ae957a0e7e5ae9580d407ed2a007dc"}
Jul 14 02:31:33.833130 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:33.832905    2563 scope.go:117] "RemoveContainer" containerID="8c2b400b43378aff8fb4de270e25294563ae957a0e7e5ae9580d407ed2a007dc"
Jul 14 02:31:34.840695 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:34.840665    2563 generic.go:356] "Generic (PLEG): container finished" podID="da8b91b5-922c-4c47-8f13-b2aff0132e48" containerID="a090b2cae97dab09bf3878b13adaf34bc1a9da5639e44b4c82e40317609b25a8" exitCode=7
Jul 14 02:31:34.841219 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:34.840745    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc" event={"ID":"da8b91b5-922c-4c47-8f13-b2aff0132e48","Type":"ContainerDied","Data":"a090b2cae97dab09bf3878b13adaf34bc1a9da5639e44b4c82e40317609b25a8"}
Jul 14 02:31:34.841219 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:34.840813    2563 scope.go:117] "RemoveContainer" containerID="8c2b400b43378aff8fb4de270e25294563ae957a0e7e5ae9580d407ed2a007dc"
Jul 14 02:31:34.841219 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:34.841091    2563 scope.go:117] "RemoveContainer" containerID="a090b2cae97dab09bf3878b13adaf34bc1a9da5639e44b4c82e40317609b25a8"
Jul 14 02:31:34.841399 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:31:34.841376    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc_odh-ai-gateway-infra(da8b91b5-922c-4c47-8f13-b2aff0132e48)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc" podUID="da8b91b5-922c-4c47-8f13-b2aff0132e48"
Jul 14 02:31:35.848083 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:35.848057    2563 scope.go:117] "RemoveContainer" containerID="a090b2cae97dab09bf3878b13adaf34bc1a9da5639e44b4c82e40317609b25a8"
Jul 14 02:31:35.848487 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:31:35.848282    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc_odh-ai-gateway-infra(da8b91b5-922c-4c47-8f13-b2aff0132e48)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc" podUID="da8b91b5-922c-4c47-8f13-b2aff0132e48"
Jul 14 02:31:50.849707 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:50.849674    2563 scope.go:117] "RemoveContainer" containerID="a090b2cae97dab09bf3878b13adaf34bc1a9da5639e44b4c82e40317609b25a8"
Jul 14 02:31:51.939556 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:51.939468    2563 generic.go:356] "Generic (PLEG): container finished" podID="da8b91b5-922c-4c47-8f13-b2aff0132e48" containerID="6ec1afa0f85d8a8f5a778183c49e7161ad054c89304dc7372727fedb94aff497" exitCode=0
Jul 14 02:31:51.939556 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:51.939539    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc" event={"ID":"da8b91b5-922c-4c47-8f13-b2aff0132e48","Type":"ContainerDied","Data":"6ec1afa0f85d8a8f5a778183c49e7161ad054c89304dc7372727fedb94aff497"}
Jul 14 02:31:51.940032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:51.939601    2563 scope.go:117] "RemoveContainer" containerID="a090b2cae97dab09bf3878b13adaf34bc1a9da5639e44b4c82e40317609b25a8"
Jul 14 02:31:52.963736 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:52.963695    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc"]
Jul 14 02:31:53.091975 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:53.091951    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc"
Jul 14 02:31:53.195398 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:53.195372    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da8b91b5-922c-4c47-8f13-b2aff0132e48-maas-api-service-ca\") pod \"da8b91b5-922c-4c47-8f13-b2aff0132e48\" (UID: \"da8b91b5-922c-4c47-8f13-b2aff0132e48\") "
Jul 14 02:31:53.195755 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:53.195729    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da8b91b5-922c-4c47-8f13-b2aff0132e48-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "da8b91b5-922c-4c47-8f13-b2aff0132e48" (UID: "da8b91b5-922c-4c47-8f13-b2aff0132e48"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:31:53.296262 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:53.296147    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da8b91b5-922c-4c47-8f13-b2aff0132e48-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:31:53.954920 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:53.954888    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc"
Jul 14 02:31:53.954920 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:53.954896    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc" event={"ID":"da8b91b5-922c-4c47-8f13-b2aff0132e48","Type":"ContainerDied","Data":"fed03b15936c441137eaee842eeae46343f9facfdf6935b595ff86060695b728"}
Jul 14 02:31:53.955212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:53.954948    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fed03b15936c441137eaee842eeae46343f9facfdf6935b595ff86060695b728"
Jul 14 02:31:53.985658 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:53.985623    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc"]
Jul 14 02:31:53.988078 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:53.988051    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-wrprc"]
Jul 14 02:31:55.855574 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:31:55.855535    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da8b91b5-922c-4c47-8f13-b2aff0132e48" path="/var/lib/kubelet/pods/da8b91b5-922c-4c47-8f13-b2aff0132e48/volumes"
Jul 14 02:32:32.007056 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.007018    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m"]
Jul 14 02:32:32.007583 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.007433    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da8b91b5-922c-4c47-8f13-b2aff0132e48" containerName="revoke-keys"
Jul 14 02:32:32.007583 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.007445    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da8b91b5-922c-4c47-8f13-b2aff0132e48" containerName="revoke-keys"
Jul 14 02:32:32.007583 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.007455    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da8b91b5-922c-4c47-8f13-b2aff0132e48" containerName="revoke-keys"
Jul 14 02:32:32.007583 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.007462    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da8b91b5-922c-4c47-8f13-b2aff0132e48" containerName="revoke-keys"
Jul 14 02:32:32.007583 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.007557    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="da8b91b5-922c-4c47-8f13-b2aff0132e48" containerName="revoke-keys"
Jul 14 02:32:32.007583 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.007566    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="da8b91b5-922c-4c47-8f13-b2aff0132e48" containerName="revoke-keys"
Jul 14 02:32:32.007583 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.007572    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="da8b91b5-922c-4c47-8f13-b2aff0132e48" containerName="revoke-keys"
Jul 14 02:32:32.010775 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.010755    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m"
Jul 14 02:32:32.013206 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.013146    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:32:32.013376 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.013232    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:32:32.017999 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.017970    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m"]
Jul 14 02:32:32.056068 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.056025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b6a396-ba96-4262-ae87-fad7bf08436b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m\" (UID: \"f0b6a396-ba96-4262-ae87-fad7bf08436b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m"
Jul 14 02:32:32.157417 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.157368    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b6a396-ba96-4262-ae87-fad7bf08436b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m\" (UID: \"f0b6a396-ba96-4262-ae87-fad7bf08436b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m"
Jul 14 02:32:32.158067 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.158042    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b6a396-ba96-4262-ae87-fad7bf08436b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m\" (UID: \"f0b6a396-ba96-4262-ae87-fad7bf08436b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m"
Jul 14 02:32:32.323295 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.323259    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m"
Jul 14 02:32:32.459282 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:32.459251    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m"]
Jul 14 02:32:32.461739 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:32:32.461704    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b6a396_ba96_4262_ae87_fad7bf08436b.slice/crio-34912b0087c01ed9335e625e71105c3d8728f9ee38091243aa56d72d4bc87ffb WatchSource:0}: Error finding container 34912b0087c01ed9335e625e71105c3d8728f9ee38091243aa56d72d4bc87ffb: Status 404 returned error can't find the container with id 34912b0087c01ed9335e625e71105c3d8728f9ee38091243aa56d72d4bc87ffb
Jul 14 02:32:33.190407 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:33.190368    2563 generic.go:356] "Generic (PLEG): container finished" podID="f0b6a396-ba96-4262-ae87-fad7bf08436b" containerID="cefced5aa99a7a740f8c0da712b368ceb7a4e9a445d7fc0a60c606448830057a" exitCode=0
Jul 14 02:32:33.190791 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:33.190450    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m" event={"ID":"f0b6a396-ba96-4262-ae87-fad7bf08436b","Type":"ContainerDied","Data":"cefced5aa99a7a740f8c0da712b368ceb7a4e9a445d7fc0a60c606448830057a"}
Jul 14 02:32:33.190791 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:33.190509    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m" event={"ID":"f0b6a396-ba96-4262-ae87-fad7bf08436b","Type":"ContainerStarted","Data":"34912b0087c01ed9335e625e71105c3d8728f9ee38091243aa56d72d4bc87ffb"}
Jul 14 02:32:34.329577 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:34.329546    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m"
Jul 14 02:32:34.376946 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:34.376900    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b6a396-ba96-4262-ae87-fad7bf08436b-maas-api-service-ca\") pod \"f0b6a396-ba96-4262-ae87-fad7bf08436b\" (UID: \"f0b6a396-ba96-4262-ae87-fad7bf08436b\") "
Jul 14 02:32:34.377312 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:34.377290    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0b6a396-ba96-4262-ae87-fad7bf08436b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f0b6a396-ba96-4262-ae87-fad7bf08436b" (UID: "f0b6a396-ba96-4262-ae87-fad7bf08436b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:32:34.478572 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:34.478463    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0b6a396-ba96-4262-ae87-fad7bf08436b-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:32:35.202298 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:35.202263    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m"
Jul 14 02:32:35.202298 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:35.202295    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m" event={"ID":"f0b6a396-ba96-4262-ae87-fad7bf08436b","Type":"ContainerDied","Data":"34912b0087c01ed9335e625e71105c3d8728f9ee38091243aa56d72d4bc87ffb"}
Jul 14 02:32:35.202516 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:35.202344    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34912b0087c01ed9335e625e71105c3d8728f9ee38091243aa56d72d4bc87ffb"
Jul 14 02:32:45.283997 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:32:45.283909    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:33:02.187787 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:02.187754    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:33:03.924936 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:03.924890    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj"]
Jul 14 02:33:03.925369 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:03.925302    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0b6a396-ba96-4262-ae87-fad7bf08436b" containerName="revoke-keys"
Jul 14 02:33:03.925369 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:03.925315    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0b6a396-ba96-4262-ae87-fad7bf08436b" containerName="revoke-keys"
Jul 14 02:33:03.925369 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:03.925341    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da8b91b5-922c-4c47-8f13-b2aff0132e48" containerName="revoke-keys"
Jul 14 02:33:03.925369 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:03.925346    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da8b91b5-922c-4c47-8f13-b2aff0132e48" containerName="revoke-keys"
Jul 14 02:33:03.925517 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:03.925411    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0b6a396-ba96-4262-ae87-fad7bf08436b" containerName="revoke-keys"
Jul 14 02:33:03.928575 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:03.928554    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj"
Jul 14 02:33:03.931491 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:03.931447    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:33:03.931491 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:03.931471    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:33:03.934130 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:03.934098    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj"]
Jul 14 02:33:04.044754 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:04.044707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbc65e2b-4d62-45a4-a83c-1c8674e43eeb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj\" (UID: \"fbc65e2b-4d62-45a4-a83c-1c8674e43eeb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj"
Jul 14 02:33:04.146110 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:04.146057    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbc65e2b-4d62-45a4-a83c-1c8674e43eeb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj\" (UID: \"fbc65e2b-4d62-45a4-a83c-1c8674e43eeb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj"
Jul 14 02:33:04.146742 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:04.146720    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbc65e2b-4d62-45a4-a83c-1c8674e43eeb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj\" (UID: \"fbc65e2b-4d62-45a4-a83c-1c8674e43eeb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj"
Jul 14 02:33:04.240878 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:04.240776    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj"
Jul 14 02:33:04.385245 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:04.385218    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj"]
Jul 14 02:33:04.387683 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:33:04.387652    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc65e2b_4d62_45a4_a83c_1c8674e43eeb.slice/crio-9206ec15036f557ece9bbc1a42083a4f237ccc2ca4be78dfc6d8e5f11ff57d17 WatchSource:0}: Error finding container 9206ec15036f557ece9bbc1a42083a4f237ccc2ca4be78dfc6d8e5f11ff57d17: Status 404 returned error can't find the container with id 9206ec15036f557ece9bbc1a42083a4f237ccc2ca4be78dfc6d8e5f11ff57d17
Jul 14 02:33:05.376583 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:05.376493    2563 generic.go:356] "Generic (PLEG): container finished" podID="fbc65e2b-4d62-45a4-a83c-1c8674e43eeb" containerID="c4de68bd0655a0aab300239c5ac0e55295cbedc1658aee26fbbe66be326ec6b3" exitCode=7
Jul 14 02:33:05.376583 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:05.376547    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj" event={"ID":"fbc65e2b-4d62-45a4-a83c-1c8674e43eeb","Type":"ContainerDied","Data":"c4de68bd0655a0aab300239c5ac0e55295cbedc1658aee26fbbe66be326ec6b3"}
Jul 14 02:33:05.376983 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:05.376603    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj" event={"ID":"fbc65e2b-4d62-45a4-a83c-1c8674e43eeb","Type":"ContainerStarted","Data":"9206ec15036f557ece9bbc1a42083a4f237ccc2ca4be78dfc6d8e5f11ff57d17"}
Jul 14 02:33:05.376983 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:05.376844    2563 scope.go:117] "RemoveContainer" containerID="c4de68bd0655a0aab300239c5ac0e55295cbedc1658aee26fbbe66be326ec6b3"
Jul 14 02:33:06.384855 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:06.384817    2563 generic.go:356] "Generic (PLEG): container finished" podID="fbc65e2b-4d62-45a4-a83c-1c8674e43eeb" containerID="9ac693b45c6968a51ac84589e9cf0535f503d3bdce096cbd73736eaa90270e7b" exitCode=7
Jul 14 02:33:06.385357 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:06.384898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj" event={"ID":"fbc65e2b-4d62-45a4-a83c-1c8674e43eeb","Type":"ContainerDied","Data":"9ac693b45c6968a51ac84589e9cf0535f503d3bdce096cbd73736eaa90270e7b"}
Jul 14 02:33:06.385357 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:06.384977    2563 scope.go:117] "RemoveContainer" containerID="c4de68bd0655a0aab300239c5ac0e55295cbedc1658aee26fbbe66be326ec6b3"
Jul 14 02:33:06.385357 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:06.385278    2563 scope.go:117] "RemoveContainer" containerID="9ac693b45c6968a51ac84589e9cf0535f503d3bdce096cbd73736eaa90270e7b"
Jul 14 02:33:06.385557 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:33:06.385533    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj_odh-ai-gateway-infra(fbc65e2b-4d62-45a4-a83c-1c8674e43eeb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj" podUID="fbc65e2b-4d62-45a4-a83c-1c8674e43eeb"
Jul 14 02:33:07.392799 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:07.392773    2563 scope.go:117] "RemoveContainer" containerID="9ac693b45c6968a51ac84589e9cf0535f503d3bdce096cbd73736eaa90270e7b"
Jul 14 02:33:07.393208 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:33:07.392963    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj_odh-ai-gateway-infra(fbc65e2b-4d62-45a4-a83c-1c8674e43eeb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj" podUID="fbc65e2b-4d62-45a4-a83c-1c8674e43eeb"
Jul 14 02:33:17.849862 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:17.849825    2563 scope.go:117] "RemoveContainer" containerID="9ac693b45c6968a51ac84589e9cf0535f503d3bdce096cbd73736eaa90270e7b"
Jul 14 02:33:18.459491 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:18.459397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj" event={"ID":"fbc65e2b-4d62-45a4-a83c-1c8674e43eeb","Type":"ContainerStarted","Data":"2739c7f80eb34879b33816f4a78a3b8107da4fea743e333e996fb3a039e212e0"}
Jul 14 02:33:18.476770 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:18.476716    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj" podStartSLOduration=15.476699576 podStartE2EDuration="15.476699576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:33:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:33:18.47449729 +0000 UTC m=+1919.157068128" watchObservedRunningTime="2026-07-14 02:33:18.476699576 +0000 UTC m=+1919.159270412"
Jul 14 02:33:19.467889 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:19.467853    2563 generic.go:356] "Generic (PLEG): container finished" podID="fbc65e2b-4d62-45a4-a83c-1c8674e43eeb" containerID="2739c7f80eb34879b33816f4a78a3b8107da4fea743e333e996fb3a039e212e0" exitCode=0
Jul 14 02:33:19.468393 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:19.467922    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj" event={"ID":"fbc65e2b-4d62-45a4-a83c-1c8674e43eeb","Type":"ContainerDied","Data":"2739c7f80eb34879b33816f4a78a3b8107da4fea743e333e996fb3a039e212e0"}
Jul 14 02:33:19.468393 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:19.467986    2563 scope.go:117] "RemoveContainer" containerID="9ac693b45c6968a51ac84589e9cf0535f503d3bdce096cbd73736eaa90270e7b"
Jul 14 02:33:19.483783 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:19.483746    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj"]
Jul 14 02:33:20.614075 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:20.614046    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj"
Jul 14 02:33:20.699138 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:20.699101    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbc65e2b-4d62-45a4-a83c-1c8674e43eeb-maas-api-service-ca\") pod \"fbc65e2b-4d62-45a4-a83c-1c8674e43eeb\" (UID: \"fbc65e2b-4d62-45a4-a83c-1c8674e43eeb\") "
Jul 14 02:33:20.699512 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:20.699486    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbc65e2b-4d62-45a4-a83c-1c8674e43eeb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fbc65e2b-4d62-45a4-a83c-1c8674e43eeb" (UID: "fbc65e2b-4d62-45a4-a83c-1c8674e43eeb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:33:20.800360 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:20.800279    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbc65e2b-4d62-45a4-a83c-1c8674e43eeb-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:33:21.483274 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:21.483240    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj"
Jul 14 02:33:21.483467 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:21.483287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj" event={"ID":"fbc65e2b-4d62-45a4-a83c-1c8674e43eeb","Type":"ContainerDied","Data":"9206ec15036f557ece9bbc1a42083a4f237ccc2ca4be78dfc6d8e5f11ff57d17"}
Jul 14 02:33:21.483467 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:21.483343    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9206ec15036f557ece9bbc1a42083a4f237ccc2ca4be78dfc6d8e5f11ff57d17"
Jul 14 02:33:21.512122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:21.512082    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj"]
Jul 14 02:33:21.517586 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:21.517556    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-h2jbj"]
Jul 14 02:33:21.855792 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:21.855749    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbc65e2b-4d62-45a4-a83c-1c8674e43eeb" path="/var/lib/kubelet/pods/fbc65e2b-4d62-45a4-a83c-1c8674e43eeb/volumes"
Jul 14 02:33:53.959156 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:53.959117    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l"]
Jul 14 02:33:53.959646 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:53.959532    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc65e2b-4d62-45a4-a83c-1c8674e43eeb" containerName="revoke-keys"
Jul 14 02:33:53.959646 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:53.959545    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc65e2b-4d62-45a4-a83c-1c8674e43eeb" containerName="revoke-keys"
Jul 14 02:33:53.959646 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:53.959557    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc65e2b-4d62-45a4-a83c-1c8674e43eeb" containerName="revoke-keys"
Jul 14 02:33:53.959646 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:53.959563    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc65e2b-4d62-45a4-a83c-1c8674e43eeb" containerName="revoke-keys"
Jul 14 02:33:53.959646 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:53.959575    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc65e2b-4d62-45a4-a83c-1c8674e43eeb" containerName="revoke-keys"
Jul 14 02:33:53.959646 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:53.959581    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc65e2b-4d62-45a4-a83c-1c8674e43eeb" containerName="revoke-keys"
Jul 14 02:33:53.959646 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:53.959642    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbc65e2b-4d62-45a4-a83c-1c8674e43eeb" containerName="revoke-keys"
Jul 14 02:33:53.959867 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:53.959654    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbc65e2b-4d62-45a4-a83c-1c8674e43eeb" containerName="revoke-keys"
Jul 14 02:33:53.962765 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:53.962743    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l"
Jul 14 02:33:53.965504 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:53.965472    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:33:53.965504 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:53.965493    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:33:53.970184 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:53.970145    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l"]
Jul 14 02:33:54.098928 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:54.098890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97c6be93-5f1c-447d-a772-5e82e0e0def6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l\" (UID: \"97c6be93-5f1c-447d-a772-5e82e0e0def6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l"
Jul 14 02:33:54.199971 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:54.199936    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97c6be93-5f1c-447d-a772-5e82e0e0def6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l\" (UID: \"97c6be93-5f1c-447d-a772-5e82e0e0def6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l"
Jul 14 02:33:54.200585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:54.200563    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97c6be93-5f1c-447d-a772-5e82e0e0def6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l\" (UID: \"97c6be93-5f1c-447d-a772-5e82e0e0def6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l"
Jul 14 02:33:54.275047 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:54.274924    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l"
Jul 14 02:33:54.421425 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:54.421397    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l"]
Jul 14 02:33:54.424359 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:33:54.424325    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c6be93_5f1c_447d_a772_5e82e0e0def6.slice/crio-352a9778ee2f984a3f42fbedb5adc11d04281b6150f7c12c4617740377752e64 WatchSource:0}: Error finding container 352a9778ee2f984a3f42fbedb5adc11d04281b6150f7c12c4617740377752e64: Status 404 returned error can't find the container with id 352a9778ee2f984a3f42fbedb5adc11d04281b6150f7c12c4617740377752e64
Jul 14 02:33:54.679298 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:54.679261    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l" event={"ID":"97c6be93-5f1c-447d-a772-5e82e0e0def6","Type":"ContainerStarted","Data":"352a9778ee2f984a3f42fbedb5adc11d04281b6150f7c12c4617740377752e64"}
Jul 14 02:33:55.694571 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:55.694533    2563 generic.go:356] "Generic (PLEG): container finished" podID="97c6be93-5f1c-447d-a772-5e82e0e0def6" containerID="d874c78ac7e9e37bde73d27b261f5dc574f4020fda60bcf28c30d5d41e9cd72c" exitCode=0
Jul 14 02:33:55.694936 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:55.694600    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l" event={"ID":"97c6be93-5f1c-447d-a772-5e82e0e0def6","Type":"ContainerDied","Data":"d874c78ac7e9e37bde73d27b261f5dc574f4020fda60bcf28c30d5d41e9cd72c"}
Jul 14 02:33:56.836815 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:56.836784    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l"
Jul 14 02:33:56.926541 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:56.926499    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97c6be93-5f1c-447d-a772-5e82e0e0def6-maas-api-service-ca\") pod \"97c6be93-5f1c-447d-a772-5e82e0e0def6\" (UID: \"97c6be93-5f1c-447d-a772-5e82e0e0def6\") "
Jul 14 02:33:56.926878 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:56.926856    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97c6be93-5f1c-447d-a772-5e82e0e0def6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "97c6be93-5f1c-447d-a772-5e82e0e0def6" (UID: "97c6be93-5f1c-447d-a772-5e82e0e0def6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:33:57.027668 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:57.027581    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97c6be93-5f1c-447d-a772-5e82e0e0def6-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:33:57.707297 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:57.707261    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l"
Jul 14 02:33:57.707483 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:57.707292    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l" event={"ID":"97c6be93-5f1c-447d-a772-5e82e0e0def6","Type":"ContainerDied","Data":"352a9778ee2f984a3f42fbedb5adc11d04281b6150f7c12c4617740377752e64"}
Jul 14 02:33:57.707483 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:33:57.707341    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="352a9778ee2f984a3f42fbedb5adc11d04281b6150f7c12c4617740377752e64"
Jul 14 02:34:07.188844 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:34:07.188810    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:35:20.057452 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:35:20.057419    2563 scope.go:117] "RemoveContainer" containerID="cc7db16e1aeaa8b179ac34e65cd670e676649f566279db124685a9324e0e48fd"
Jul 14 02:35:42.082887 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:35:42.082800    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:35:49.985719 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:35:49.985675    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:36:01.887278 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:01.887239    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:36:08.376759 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:08.376717    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb"]
Jul 14 02:36:08.377203 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:08.377141    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c6be93-5f1c-447d-a772-5e82e0e0def6" containerName="revoke-keys"
Jul 14 02:36:08.377203 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:08.377154    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c6be93-5f1c-447d-a772-5e82e0e0def6" containerName="revoke-keys"
Jul 14 02:36:08.377284 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:08.377228    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbc65e2b-4d62-45a4-a83c-1c8674e43eeb" containerName="revoke-keys"
Jul 14 02:36:08.377284 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:08.377242    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c6be93-5f1c-447d-a772-5e82e0e0def6" containerName="revoke-keys"
Jul 14 02:36:08.379833 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:08.379817    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb"
Jul 14 02:36:08.382572 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:08.382547    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:36:08.382572 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:08.382562    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:36:08.388348 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:08.387896    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb"]
Jul 14 02:36:08.572566 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:08.572527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/284758f4-26a3-477a-8195-19f709b74c8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb\" (UID: \"284758f4-26a3-477a-8195-19f709b74c8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb"
Jul 14 02:36:08.673537 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:08.673443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/284758f4-26a3-477a-8195-19f709b74c8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb\" (UID: \"284758f4-26a3-477a-8195-19f709b74c8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb"
Jul 14 02:36:08.674125 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:08.674102    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/284758f4-26a3-477a-8195-19f709b74c8d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb\" (UID: \"284758f4-26a3-477a-8195-19f709b74c8d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb"
Jul 14 02:36:08.693069 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:08.693035    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb"
Jul 14 02:36:08.830261 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:08.830234    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb"]
Jul 14 02:36:08.832261 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:36:08.832219    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284758f4_26a3_477a_8195_19f709b74c8d.slice/crio-649bfc6adf036b01965754f43f8aeeb7f8c08ec81f604b2f84c3d0f20c39a0f6 WatchSource:0}: Error finding container 649bfc6adf036b01965754f43f8aeeb7f8c08ec81f604b2f84c3d0f20c39a0f6: Status 404 returned error can't find the container with id 649bfc6adf036b01965754f43f8aeeb7f8c08ec81f604b2f84c3d0f20c39a0f6
Jul 14 02:36:09.473779 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:09.473734    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb" event={"ID":"284758f4-26a3-477a-8195-19f709b74c8d","Type":"ContainerStarted","Data":"74443290564d62c8191b8706d70c7292c8deeb82967b5befdbd2858096488a6c"}
Jul 14 02:36:09.474192 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:09.473802    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb" event={"ID":"284758f4-26a3-477a-8195-19f709b74c8d","Type":"ContainerStarted","Data":"649bfc6adf036b01965754f43f8aeeb7f8c08ec81f604b2f84c3d0f20c39a0f6"}
Jul 14 02:36:09.489470 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:09.489417    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb" podStartSLOduration=1.489398386 podStartE2EDuration="1.489398386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:36:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:36:09.486804468 +0000 UTC m=+2090.169375326" watchObservedRunningTime="2026-07-14 02:36:09.489398386 +0000 UTC m=+2090.171969223"
Jul 14 02:36:10.481182 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:10.481143    2563 generic.go:356] "Generic (PLEG): container finished" podID="284758f4-26a3-477a-8195-19f709b74c8d" containerID="74443290564d62c8191b8706d70c7292c8deeb82967b5befdbd2858096488a6c" exitCode=0
Jul 14 02:36:10.481582 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:10.481221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb" event={"ID":"284758f4-26a3-477a-8195-19f709b74c8d","Type":"ContainerDied","Data":"74443290564d62c8191b8706d70c7292c8deeb82967b5befdbd2858096488a6c"}
Jul 14 02:36:11.626669 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:11.626642    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb"
Jul 14 02:36:11.697411 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:11.697371    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/284758f4-26a3-477a-8195-19f709b74c8d-maas-api-service-ca\") pod \"284758f4-26a3-477a-8195-19f709b74c8d\" (UID: \"284758f4-26a3-477a-8195-19f709b74c8d\") "
Jul 14 02:36:11.697749 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:11.697726    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/284758f4-26a3-477a-8195-19f709b74c8d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "284758f4-26a3-477a-8195-19f709b74c8d" (UID: "284758f4-26a3-477a-8195-19f709b74c8d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:36:11.798603 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:11.798523    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/284758f4-26a3-477a-8195-19f709b74c8d-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:36:12.494775 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:12.494741    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb"
Jul 14 02:36:12.494775 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:12.494768    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb" event={"ID":"284758f4-26a3-477a-8195-19f709b74c8d","Type":"ContainerDied","Data":"649bfc6adf036b01965754f43f8aeeb7f8c08ec81f604b2f84c3d0f20c39a0f6"}
Jul 14 02:36:12.495012 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:12.494815    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="649bfc6adf036b01965754f43f8aeeb7f8c08ec81f604b2f84c3d0f20c39a0f6"
Jul 14 02:36:20.826614 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:20.826587    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:36:20.830480 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:20.830452    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:36:20.837074 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:20.837048    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:36:20.840816 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:20.840793    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:36:21.781475 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:36:21.781437    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:37:01.490974 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:01.490939    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:37:18.884366 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:18.884291    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:37:20.090374 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:20.090333    2563 scope.go:117] "RemoveContainer" containerID="324974d018fa18e604a92a7ca9123c0c11be164e54766e8d5cc7f7a4970ea348"
Jul 14 02:37:35.484274 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:35.484230    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:37:38.857616 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:38.857575    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m"]
Jul 14 02:37:38.858009 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:38.857977    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284758f4-26a3-477a-8195-19f709b74c8d" containerName="revoke-keys"
Jul 14 02:37:38.858009 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:38.857988    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="284758f4-26a3-477a-8195-19f709b74c8d" containerName="revoke-keys"
Jul 14 02:37:38.858107 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:38.858097    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="284758f4-26a3-477a-8195-19f709b74c8d" containerName="revoke-keys"
Jul 14 02:37:38.861569 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:38.861550    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m"
Jul 14 02:37:38.865023 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:38.864994    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:37:38.865284 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:38.865042    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:37:38.867526 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:38.867494    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m"]
Jul 14 02:37:38.984848 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:38.984810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/156ccf49-b0da-4a61-9872-7e56a2bc9e59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m\" (UID: \"156ccf49-b0da-4a61-9872-7e56a2bc9e59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m"
Jul 14 02:37:39.086336 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:39.086296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/156ccf49-b0da-4a61-9872-7e56a2bc9e59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m\" (UID: \"156ccf49-b0da-4a61-9872-7e56a2bc9e59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m"
Jul 14 02:37:39.086961 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:39.086937    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/156ccf49-b0da-4a61-9872-7e56a2bc9e59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m\" (UID: \"156ccf49-b0da-4a61-9872-7e56a2bc9e59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m"
Jul 14 02:37:39.175225 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:39.175109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m"
Jul 14 02:37:39.313067 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:39.313029    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m"]
Jul 14 02:37:39.314934 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:37:39.314905    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod156ccf49_b0da_4a61_9872_7e56a2bc9e59.slice/crio-2caa49f79206d9c5c5142eb09a92ceefed6aac4e0009f35aded2b46aaf236bba WatchSource:0}: Error finding container 2caa49f79206d9c5c5142eb09a92ceefed6aac4e0009f35aded2b46aaf236bba: Status 404 returned error can't find the container with id 2caa49f79206d9c5c5142eb09a92ceefed6aac4e0009f35aded2b46aaf236bba
Jul 14 02:37:40.009338 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:40.009300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m" event={"ID":"156ccf49-b0da-4a61-9872-7e56a2bc9e59","Type":"ContainerStarted","Data":"ee8eb5d435ce6eff564a81d05f7ea1456eceed361b2f2380cafd59043af32595"}
Jul 14 02:37:40.009739 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:40.009359    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m" event={"ID":"156ccf49-b0da-4a61-9872-7e56a2bc9e59","Type":"ContainerStarted","Data":"2caa49f79206d9c5c5142eb09a92ceefed6aac4e0009f35aded2b46aaf236bba"}
Jul 14 02:37:40.025483 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:40.025434    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m" podStartSLOduration=2.02541546 podStartE2EDuration="2.02541546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:37:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:37:40.02287439 +0000 UTC m=+2180.705445252" watchObservedRunningTime="2026-07-14 02:37:40.02541546 +0000 UTC m=+2180.707986297"
Jul 14 02:37:41.016430 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:41.016389    2563 generic.go:356] "Generic (PLEG): container finished" podID="156ccf49-b0da-4a61-9872-7e56a2bc9e59" containerID="ee8eb5d435ce6eff564a81d05f7ea1456eceed361b2f2380cafd59043af32595" exitCode=0
Jul 14 02:37:41.016833 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:41.016471    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m" event={"ID":"156ccf49-b0da-4a61-9872-7e56a2bc9e59","Type":"ContainerDied","Data":"ee8eb5d435ce6eff564a81d05f7ea1456eceed361b2f2380cafd59043af32595"}
Jul 14 02:37:42.162352 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:42.162324    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m"
Jul 14 02:37:42.316659 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:42.316632    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/156ccf49-b0da-4a61-9872-7e56a2bc9e59-maas-api-service-ca\") pod \"156ccf49-b0da-4a61-9872-7e56a2bc9e59\" (UID: \"156ccf49-b0da-4a61-9872-7e56a2bc9e59\") "
Jul 14 02:37:42.317028 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:42.317003    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/156ccf49-b0da-4a61-9872-7e56a2bc9e59-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "156ccf49-b0da-4a61-9872-7e56a2bc9e59" (UID: "156ccf49-b0da-4a61-9872-7e56a2bc9e59"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:37:42.418324 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:42.418275    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/156ccf49-b0da-4a61-9872-7e56a2bc9e59-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:37:43.029564 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:43.029536    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m"
Jul 14 02:37:43.029741 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:43.029562    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m" event={"ID":"156ccf49-b0da-4a61-9872-7e56a2bc9e59","Type":"ContainerDied","Data":"2caa49f79206d9c5c5142eb09a92ceefed6aac4e0009f35aded2b46aaf236bba"}
Jul 14 02:37:43.029741 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:43.029607    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2caa49f79206d9c5c5142eb09a92ceefed6aac4e0009f35aded2b46aaf236bba"
Jul 14 02:37:52.790433 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:37:52.790393    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:38:20.114891 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:38:20.114850    2563 scope.go:117] "RemoveContainer" containerID="6ec1afa0f85d8a8f5a778183c49e7161ad054c89304dc7372727fedb94aff497"
Jul 14 02:38:51.885071 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:38:51.884985    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:39:01.490605 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:39:01.490559    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:39:20.138061 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:39:20.138018    2563 scope.go:117] "RemoveContainer" containerID="2739c7f80eb34879b33816f4a78a3b8107da4fea743e333e996fb3a039e212e0"
Jul 14 02:39:51.593272 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:39:51.593221    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:40:06.190536 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:06.190495    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:40:33.885461 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:33.885380    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:40:48.582239 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:48.582200    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:40:49.953730 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:49.953690    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk"]
Jul 14 02:40:49.954118 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:49.954093    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="156ccf49-b0da-4a61-9872-7e56a2bc9e59" containerName="revoke-keys"
Jul 14 02:40:49.954118 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:49.954104    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="156ccf49-b0da-4a61-9872-7e56a2bc9e59" containerName="revoke-keys"
Jul 14 02:40:49.954231 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:49.954186    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="156ccf49-b0da-4a61-9872-7e56a2bc9e59" containerName="revoke-keys"
Jul 14 02:40:49.957426 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:49.957407    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk"
Jul 14 02:40:49.960279 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:49.960196    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:40:49.961122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:49.961097    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:40:49.963810 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:49.963788    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk"]
Jul 14 02:40:50.051779 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:50.051732    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89cae796-3459-4b4c-8d6a-101abbfd58d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk\" (UID: \"89cae796-3459-4b4c-8d6a-101abbfd58d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk"
Jul 14 02:40:50.152961 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:50.152916    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89cae796-3459-4b4c-8d6a-101abbfd58d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk\" (UID: \"89cae796-3459-4b4c-8d6a-101abbfd58d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk"
Jul 14 02:40:50.153653 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:50.153628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89cae796-3459-4b4c-8d6a-101abbfd58d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk\" (UID: \"89cae796-3459-4b4c-8d6a-101abbfd58d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk"
Jul 14 02:40:50.271359 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:50.271267    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk"
Jul 14 02:40:50.408112 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:50.408078    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk"]
Jul 14 02:40:50.409592 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:40:50.409562    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89cae796_3459_4b4c_8d6a_101abbfd58d3.slice/crio-8dabd39d27173dd14c324ac45139779d4624a4f4a50ffaa5bc41b5ecdadb03bf WatchSource:0}: Error finding container 8dabd39d27173dd14c324ac45139779d4624a4f4a50ffaa5bc41b5ecdadb03bf: Status 404 returned error can't find the container with id 8dabd39d27173dd14c324ac45139779d4624a4f4a50ffaa5bc41b5ecdadb03bf
Jul 14 02:40:51.137337 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:51.137307    2563 generic.go:356] "Generic (PLEG): container finished" podID="89cae796-3459-4b4c-8d6a-101abbfd58d3" containerID="3e1c3c3cabe92e478cc1c40e1484d43b09a559bd233462ffdde311dcc4e46827" exitCode=0
Jul 14 02:40:51.137711 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:51.137353    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk" event={"ID":"89cae796-3459-4b4c-8d6a-101abbfd58d3","Type":"ContainerDied","Data":"3e1c3c3cabe92e478cc1c40e1484d43b09a559bd233462ffdde311dcc4e46827"}
Jul 14 02:40:51.137711 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:51.137398    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk" event={"ID":"89cae796-3459-4b4c-8d6a-101abbfd58d3","Type":"ContainerStarted","Data":"8dabd39d27173dd14c324ac45139779d4624a4f4a50ffaa5bc41b5ecdadb03bf"}
Jul 14 02:40:52.277375 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:52.277351    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk"
Jul 14 02:40:52.372702 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:52.372663    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89cae796-3459-4b4c-8d6a-101abbfd58d3-maas-api-service-ca\") pod \"89cae796-3459-4b4c-8d6a-101abbfd58d3\" (UID: \"89cae796-3459-4b4c-8d6a-101abbfd58d3\") "
Jul 14 02:40:52.373047 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:52.373021    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89cae796-3459-4b4c-8d6a-101abbfd58d3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "89cae796-3459-4b4c-8d6a-101abbfd58d3" (UID: "89cae796-3459-4b4c-8d6a-101abbfd58d3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:40:52.473931 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:52.473824    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89cae796-3459-4b4c-8d6a-101abbfd58d3-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:40:53.150129 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:53.150094    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk"
Jul 14 02:40:53.150334 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:53.150131    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk" event={"ID":"89cae796-3459-4b4c-8d6a-101abbfd58d3","Type":"ContainerDied","Data":"8dabd39d27173dd14c324ac45139779d4624a4f4a50ffaa5bc41b5ecdadb03bf"}
Jul 14 02:40:53.150334 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:40:53.150209    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8dabd39d27173dd14c324ac45139779d4624a4f4a50ffaa5bc41b5ecdadb03bf"
Jul 14 02:41:01.089880 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:01.089842    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:41:12.082259 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:12.082220    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:41:16.075340 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:16.075293    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx"]
Jul 14 02:41:16.075892 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:16.075868    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89cae796-3459-4b4c-8d6a-101abbfd58d3" containerName="revoke-keys"
Jul 14 02:41:16.075975 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:16.075894    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="89cae796-3459-4b4c-8d6a-101abbfd58d3" containerName="revoke-keys"
Jul 14 02:41:16.076031 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:16.076004    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="89cae796-3459-4b4c-8d6a-101abbfd58d3" containerName="revoke-keys"
Jul 14 02:41:16.079330 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:16.079306    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx"
Jul 14 02:41:16.081832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:16.081812    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:41:16.081945 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:16.081813    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:41:16.086593 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:16.086565    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx"]
Jul 14 02:41:16.164392 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:16.164353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29ad3739-211b-453e-92ce-d0b5b793e696-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx\" (UID: \"29ad3739-211b-453e-92ce-d0b5b793e696\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx"
Jul 14 02:41:16.265932 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:16.265880    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29ad3739-211b-453e-92ce-d0b5b793e696-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx\" (UID: \"29ad3739-211b-453e-92ce-d0b5b793e696\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx"
Jul 14 02:41:16.266560 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:16.266540    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29ad3739-211b-453e-92ce-d0b5b793e696-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx\" (UID: \"29ad3739-211b-453e-92ce-d0b5b793e696\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx"
Jul 14 02:41:16.391344 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:16.391227    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx"
Jul 14 02:41:16.531127 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:16.531094    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx"]
Jul 14 02:41:16.532919 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:41:16.532892    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ad3739_211b_453e_92ce_d0b5b793e696.slice/crio-7fce3607b7195daf35b4a64dbcb5b6a45e9b35088967085a4d50527665127e0e WatchSource:0}: Error finding container 7fce3607b7195daf35b4a64dbcb5b6a45e9b35088967085a4d50527665127e0e: Status 404 returned error can't find the container with id 7fce3607b7195daf35b4a64dbcb5b6a45e9b35088967085a4d50527665127e0e
Jul 14 02:41:17.303488 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:17.303453    2563 generic.go:356] "Generic (PLEG): container finished" podID="29ad3739-211b-453e-92ce-d0b5b793e696" containerID="1ed978ebb18863cfe80c10cddf0d8aa293ef700051480695536a7a3516638f50" exitCode=0
Jul 14 02:41:17.303884 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:17.303530    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx" event={"ID":"29ad3739-211b-453e-92ce-d0b5b793e696","Type":"ContainerDied","Data":"1ed978ebb18863cfe80c10cddf0d8aa293ef700051480695536a7a3516638f50"}
Jul 14 02:41:17.303884 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:17.303580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx" event={"ID":"29ad3739-211b-453e-92ce-d0b5b793e696","Type":"ContainerStarted","Data":"7fce3607b7195daf35b4a64dbcb5b6a45e9b35088967085a4d50527665127e0e"}
Jul 14 02:41:18.447344 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:18.447316    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx"
Jul 14 02:41:18.489116 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:18.489070    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29ad3739-211b-453e-92ce-d0b5b793e696-maas-api-service-ca\") pod \"29ad3739-211b-453e-92ce-d0b5b793e696\" (UID: \"29ad3739-211b-453e-92ce-d0b5b793e696\") "
Jul 14 02:41:18.489463 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:18.489441    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29ad3739-211b-453e-92ce-d0b5b793e696-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "29ad3739-211b-453e-92ce-d0b5b793e696" (UID: "29ad3739-211b-453e-92ce-d0b5b793e696"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:41:18.590710 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:18.590671    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29ad3739-211b-453e-92ce-d0b5b793e696-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:41:19.316788 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:19.316759    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx"
Jul 14 02:41:19.316969 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:19.316797    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx" event={"ID":"29ad3739-211b-453e-92ce-d0b5b793e696","Type":"ContainerDied","Data":"7fce3607b7195daf35b4a64dbcb5b6a45e9b35088967085a4d50527665127e0e"}
Jul 14 02:41:19.316969 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:19.316845    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7fce3607b7195daf35b4a64dbcb5b6a45e9b35088967085a4d50527665127e0e"
Jul 14 02:41:20.870402 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:20.870366    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:41:20.874257 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:20.874229    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:41:20.882860 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:20.882836    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:41:20.886535 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:20.886513    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:41:29.585766 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:29.585729    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:41:50.685313 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:41:50.685229    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:42:06.108715 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:06.108678    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9794b6-76bpg"]
Jul 14 02:42:06.109156 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:06.109063    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29ad3739-211b-453e-92ce-d0b5b793e696" containerName="revoke-keys"
Jul 14 02:42:06.109156 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:06.109074    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="29ad3739-211b-453e-92ce-d0b5b793e696" containerName="revoke-keys"
Jul 14 02:42:06.109283 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:06.109191    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="29ad3739-211b-453e-92ce-d0b5b793e696" containerName="revoke-keys"
Jul 14 02:42:06.112147 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:06.112129    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9794b6-76bpg"
Jul 14 02:42:06.114956 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:06.114929    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:42:06.116215 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:06.116186    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:42:06.120709 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:06.120084    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9794b6-76bpg"]
Jul 14 02:42:06.242201 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:06.242129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55c3e9d6-fb94-4152-b291-9021f279f282-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9794b6-76bpg\" (UID: \"55c3e9d6-fb94-4152-b291-9021f279f282\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9794b6-76bpg"
Jul 14 02:42:06.343613 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:06.343573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55c3e9d6-fb94-4152-b291-9021f279f282-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9794b6-76bpg\" (UID: \"55c3e9d6-fb94-4152-b291-9021f279f282\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9794b6-76bpg"
Jul 14 02:42:06.344254 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:06.344234    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55c3e9d6-fb94-4152-b291-9021f279f282-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-9794b6-76bpg\" (UID: \"55c3e9d6-fb94-4152-b291-9021f279f282\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9794b6-76bpg"
Jul 14 02:42:06.423669 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:06.423587    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9794b6-76bpg"
Jul 14 02:42:06.563885 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:06.563851    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9794b6-76bpg"]
Jul 14 02:42:06.565739 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:42:06.565711    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c3e9d6_fb94_4152_b291_9021f279f282.slice/crio-e0edb4800ff6cfa9a70202339b9c98f2d90c83e1a92b82d08bcf0d608a06ad76 WatchSource:0}: Error finding container e0edb4800ff6cfa9a70202339b9c98f2d90c83e1a92b82d08bcf0d608a06ad76: Status 404 returned error can't find the container with id e0edb4800ff6cfa9a70202339b9c98f2d90c83e1a92b82d08bcf0d608a06ad76
Jul 14 02:42:06.589992 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:06.589961    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9794b6-76bpg" event={"ID":"55c3e9d6-fb94-4152-b291-9021f279f282","Type":"ContainerStarted","Data":"e0edb4800ff6cfa9a70202339b9c98f2d90c83e1a92b82d08bcf0d608a06ad76"}
Jul 14 02:42:07.596799 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:07.596769    2563 generic.go:356] "Generic (PLEG): container finished" podID="55c3e9d6-fb94-4152-b291-9021f279f282" containerID="a72998a91f32046b5eda04fec3a0b4171818f0ac47813dcd88663d06b79369bb" exitCode=0
Jul 14 02:42:07.597201 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:07.596833    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9794b6-76bpg" event={"ID":"55c3e9d6-fb94-4152-b291-9021f279f282","Type":"ContainerDied","Data":"a72998a91f32046b5eda04fec3a0b4171818f0ac47813dcd88663d06b79369bb"}
Jul 14 02:42:07.690939 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:07.690898    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:42:08.741912 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:08.741881    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9794b6-76bpg"
Jul 14 02:42:08.869002 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:08.868914    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55c3e9d6-fb94-4152-b291-9021f279f282-maas-api-service-ca\") pod \"55c3e9d6-fb94-4152-b291-9021f279f282\" (UID: \"55c3e9d6-fb94-4152-b291-9021f279f282\") "
Jul 14 02:42:08.869364 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:08.869337    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55c3e9d6-fb94-4152-b291-9021f279f282-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "55c3e9d6-fb94-4152-b291-9021f279f282" (UID: "55c3e9d6-fb94-4152-b291-9021f279f282"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:42:08.969676 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:08.969634    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55c3e9d6-fb94-4152-b291-9021f279f282-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:42:09.612156 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:09.612129    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9794b6-76bpg"
Jul 14 02:42:09.612352 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:09.612204    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-9794b6-76bpg" event={"ID":"55c3e9d6-fb94-4152-b291-9021f279f282","Type":"ContainerDied","Data":"e0edb4800ff6cfa9a70202339b9c98f2d90c83e1a92b82d08bcf0d608a06ad76"}
Jul 14 02:42:09.612352 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:09.612258    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0edb4800ff6cfa9a70202339b9c98f2d90c83e1a92b82d08bcf0d608a06ad76"
Jul 14 02:42:20.388046 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:20.388006    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:42:32.261798 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:32.261758    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4"]
Jul 14 02:42:32.262303 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:32.262146    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c3e9d6-fb94-4152-b291-9021f279f282" containerName="revoke-keys"
Jul 14 02:42:32.262303 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:32.262157    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c3e9d6-fb94-4152-b291-9021f279f282" containerName="revoke-keys"
Jul 14 02:42:32.262303 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:32.262255    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c3e9d6-fb94-4152-b291-9021f279f282" containerName="revoke-keys"
Jul 14 02:42:32.265397 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:32.265376    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4"
Jul 14 02:42:32.267986 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:32.267955    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:42:32.268132 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:32.268020    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:42:32.273585 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:32.273553    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4"]
Jul 14 02:42:32.289046 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:32.289005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92fd94ec-baa0-412e-804f-3801c2f4bb59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4\" (UID: \"92fd94ec-baa0-412e-804f-3801c2f4bb59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4"
Jul 14 02:42:32.389572 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:32.389527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92fd94ec-baa0-412e-804f-3801c2f4bb59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4\" (UID: \"92fd94ec-baa0-412e-804f-3801c2f4bb59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4"
Jul 14 02:42:32.390221 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:32.390201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92fd94ec-baa0-412e-804f-3801c2f4bb59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4\" (UID: \"92fd94ec-baa0-412e-804f-3801c2f4bb59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4"
Jul 14 02:42:32.577370 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:32.577335    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4"
Jul 14 02:42:32.720520 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:32.720493    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4"]
Jul 14 02:42:32.722953 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:42:32.722926    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92fd94ec_baa0_412e_804f_3801c2f4bb59.slice/crio-5085a7387d234d5fe61602210651fd084c8b69043cfdba44ede0e9d67568b0b4 WatchSource:0}: Error finding container 5085a7387d234d5fe61602210651fd084c8b69043cfdba44ede0e9d67568b0b4: Status 404 returned error can't find the container with id 5085a7387d234d5fe61602210651fd084c8b69043cfdba44ede0e9d67568b0b4
Jul 14 02:42:32.748322 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:32.748290    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4" event={"ID":"92fd94ec-baa0-412e-804f-3801c2f4bb59","Type":"ContainerStarted","Data":"5085a7387d234d5fe61602210651fd084c8b69043cfdba44ede0e9d67568b0b4"}
Jul 14 02:42:33.755620 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:33.755581    2563 generic.go:356] "Generic (PLEG): container finished" podID="92fd94ec-baa0-412e-804f-3801c2f4bb59" containerID="043ee7c49d14e034820f7aed55a94132b7186141a0871bdcbdcf4b4bdc1f3bb7" exitCode=0
Jul 14 02:42:33.756008 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:33.755656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4" event={"ID":"92fd94ec-baa0-412e-804f-3801c2f4bb59","Type":"ContainerDied","Data":"043ee7c49d14e034820f7aed55a94132b7186141a0871bdcbdcf4b4bdc1f3bb7"}
Jul 14 02:42:34.899106 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:34.899080    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4"
Jul 14 02:42:34.910043 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:34.910011    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92fd94ec-baa0-412e-804f-3801c2f4bb59-maas-api-service-ca\") pod \"92fd94ec-baa0-412e-804f-3801c2f4bb59\" (UID: \"92fd94ec-baa0-412e-804f-3801c2f4bb59\") "
Jul 14 02:42:34.910725 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:34.910381    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92fd94ec-baa0-412e-804f-3801c2f4bb59-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "92fd94ec-baa0-412e-804f-3801c2f4bb59" (UID: "92fd94ec-baa0-412e-804f-3801c2f4bb59"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:42:35.011153 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:35.011115    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92fd94ec-baa0-412e-804f-3801c2f4bb59-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:42:35.768973 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:35.768938    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4"
Jul 14 02:42:35.768973 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:35.768962    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4" event={"ID":"92fd94ec-baa0-412e-804f-3801c2f4bb59","Type":"ContainerDied","Data":"5085a7387d234d5fe61602210651fd084c8b69043cfdba44ede0e9d67568b0b4"}
Jul 14 02:42:35.769252 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:35.769007    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5085a7387d234d5fe61602210651fd084c8b69043cfdba44ede0e9d67568b0b4"
Jul 14 02:42:46.388872 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:42:46.388832    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:43:06.785623 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:43:06.785586    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:43:23.085931 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:43:23.085839    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:43:38.985110 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:43:38.985064    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:44:11.980004 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:44:11.979967    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:44:31.995714 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:44:31.995678    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:44:50.484811 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:44:50.484727    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:45:00.132756 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.132720    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c47335-29733285-rrlvg"]
Jul 14 02:45:00.133285 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.133158    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92fd94ec-baa0-412e-804f-3801c2f4bb59" containerName="revoke-keys"
Jul 14 02:45:00.133285 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.133184    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="92fd94ec-baa0-412e-804f-3801c2f4bb59" containerName="revoke-keys"
Jul 14 02:45:00.133285 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.133260    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="92fd94ec-baa0-412e-804f-3801c2f4bb59" containerName="revoke-keys"
Jul 14 02:45:00.136396 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.136374    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733285-r256z"]
Jul 14 02:45:00.136548 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.136522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c47335-29733285-rrlvg"
Jul 14 02:45:00.139136 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.139105    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:45:00.140630 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.140607    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a148c7-29733285-kz62m"]
Jul 14 02:45:00.140878 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.140728    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733285-r256z"
Jul 14 02:45:00.145123 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.145089    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c47335-29733285-rrlvg"]
Jul 14 02:45:00.145512 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.145496    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a148c7-29733285-kz62m"
Jul 14 02:45:00.147940 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.147293    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a148c7-29733285-kz62m"]
Jul 14 02:45:00.151027 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.150999    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733285-r256z"]
Jul 14 02:45:00.153211 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.153185    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c47335-29733285-rrlvg"
Jul 14 02:45:00.161571 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.161548    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733285-r256z"
Jul 14 02:45:00.199477 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.199451    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a148c7-29733285-kz62m"
Jul 14 02:45:00.319568 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.319542    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c47335-29733285-rrlvg"]
Jul 14 02:45:00.323519 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:45:00.323485    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786ee0df_9c6b_4fd0_b12d_9a71200a833f.slice/crio-20d0eae2bfd47241d04f94defef75c7bab9f6b0f7e4f5adc506048ea6f48c80c WatchSource:0}: Error finding container 20d0eae2bfd47241d04f94defef75c7bab9f6b0f7e4f5adc506048ea6f48c80c: Status 404 returned error can't find the container with id 20d0eae2bfd47241d04f94defef75c7bab9f6b0f7e4f5adc506048ea6f48c80c
Jul 14 02:45:00.353500 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.353452    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29733285-r256z"]
Jul 14 02:45:00.358256 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:45:00.358223    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f62f59_9e99_4f99_b113_813a5c7c6038.slice/crio-56832c805dcd5fb2a05e88b2a0873bebdd77644dd7789cc45ca16b37e7dd3dc0 WatchSource:0}: Error finding container 56832c805dcd5fb2a05e88b2a0873bebdd77644dd7789cc45ca16b37e7dd3dc0: Status 404 returned error can't find the container with id 56832c805dcd5fb2a05e88b2a0873bebdd77644dd7789cc45ca16b37e7dd3dc0
Jul 14 02:45:00.384790 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.384767    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a148c7-29733285-kz62m"]
Jul 14 02:45:00.389318 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:45:00.389289    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c90b21_561b_432e_ae66_a7d7cfdf6c0b.slice/crio-46dca11a2b2ed9f234983cf05f2378761d7dc3ce866584db8f56e5bedc3d6974 WatchSource:0}: Error finding container 46dca11a2b2ed9f234983cf05f2378761d7dc3ce866584db8f56e5bedc3d6974: Status 404 returned error can't find the container with id 46dca11a2b2ed9f234983cf05f2378761d7dc3ce866584db8f56e5bedc3d6974
Jul 14 02:45:00.647009 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.646898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c47335-29733285-rrlvg" event={"ID":"786ee0df-9c6b-4fd0-b12d-9a71200a833f","Type":"ContainerStarted","Data":"20d0eae2bfd47241d04f94defef75c7bab9f6b0f7e4f5adc506048ea6f48c80c"}
Jul 14 02:45:00.648566 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.648531    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733285-r256z" event={"ID":"78f62f59-9e99-4f99-b113-813a5c7c6038","Type":"ContainerStarted","Data":"11c6a112c5c4a272821d9b4ac68e2de49d87e05bc642fe93120cf3ccaaba1351"}
Jul 14 02:45:00.648711 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.648593    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733285-r256z" event={"ID":"78f62f59-9e99-4f99-b113-813a5c7c6038","Type":"ContainerStarted","Data":"56832c805dcd5fb2a05e88b2a0873bebdd77644dd7789cc45ca16b37e7dd3dc0"}
Jul 14 02:45:00.649820 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.649795    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a148c7-29733285-kz62m" event={"ID":"43c90b21-561b-432e-ae66-a7d7cfdf6c0b","Type":"ContainerStarted","Data":"46dca11a2b2ed9f234983cf05f2378761d7dc3ce866584db8f56e5bedc3d6974"}
Jul 14 02:45:00.663713 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:00.663661    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733285-r256z" podStartSLOduration=0.663644224 podStartE2EDuration="663.644224ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:45:00.661813869 +0000 UTC m=+2621.344384707" watchObservedRunningTime="2026-07-14 02:45:00.663644224 +0000 UTC m=+2621.346215102"
Jul 14 02:45:01.658644 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:01.658601    2563 generic.go:356] "Generic (PLEG): container finished" podID="786ee0df-9c6b-4fd0-b12d-9a71200a833f" containerID="954062ac58ea2345cbc5632cf735455863238687e196081edb0374e70b4cc125" exitCode=0
Jul 14 02:45:01.659145 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:01.658685    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c47335-29733285-rrlvg" event={"ID":"786ee0df-9c6b-4fd0-b12d-9a71200a833f","Type":"ContainerDied","Data":"954062ac58ea2345cbc5632cf735455863238687e196081edb0374e70b4cc125"}
Jul 14 02:45:01.660276 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:01.660252    2563 generic.go:356] "Generic (PLEG): container finished" podID="78f62f59-9e99-4f99-b113-813a5c7c6038" containerID="11c6a112c5c4a272821d9b4ac68e2de49d87e05bc642fe93120cf3ccaaba1351" exitCode=0
Jul 14 02:45:01.660387 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:01.660300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733285-r256z" event={"ID":"78f62f59-9e99-4f99-b113-813a5c7c6038","Type":"ContainerDied","Data":"11c6a112c5c4a272821d9b4ac68e2de49d87e05bc642fe93120cf3ccaaba1351"}
Jul 14 02:45:01.661832 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:01.661811    2563 generic.go:356] "Generic (PLEG): container finished" podID="43c90b21-561b-432e-ae66-a7d7cfdf6c0b" containerID="e85a71330e32a63215f1cea4be2feb685963aa8764829d6dba707576d55792db" exitCode=0
Jul 14 02:45:01.661910 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:01.661888    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a148c7-29733285-kz62m" event={"ID":"43c90b21-561b-432e-ae66-a7d7cfdf6c0b","Type":"ContainerDied","Data":"e85a71330e32a63215f1cea4be2feb685963aa8764829d6dba707576d55792db"}
Jul 14 02:45:02.822870 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:02.822839    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a148c7-29733285-kz62m"
Jul 14 02:45:02.851095 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:02.851068    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c47335-29733285-rrlvg"
Jul 14 02:45:02.854335 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:02.854312    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733285-r256z"
Jul 14 02:45:03.675609 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:03.675577    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c47335-29733285-rrlvg"
Jul 14 02:45:03.675824 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:03.675610    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c47335-29733285-rrlvg" event={"ID":"786ee0df-9c6b-4fd0-b12d-9a71200a833f","Type":"ContainerDied","Data":"20d0eae2bfd47241d04f94defef75c7bab9f6b0f7e4f5adc506048ea6f48c80c"}
Jul 14 02:45:03.675824 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:03.675686    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20d0eae2bfd47241d04f94defef75c7bab9f6b0f7e4f5adc506048ea6f48c80c"
Jul 14 02:45:03.677045 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:03.677021    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733285-r256z"
Jul 14 02:45:03.677226 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:03.677060    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29733285-r256z" event={"ID":"78f62f59-9e99-4f99-b113-813a5c7c6038","Type":"ContainerDied","Data":"56832c805dcd5fb2a05e88b2a0873bebdd77644dd7789cc45ca16b37e7dd3dc0"}
Jul 14 02:45:03.677226 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:03.677098    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="56832c805dcd5fb2a05e88b2a0873bebdd77644dd7789cc45ca16b37e7dd3dc0"
Jul 14 02:45:03.678567 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:03.678538    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a148c7-29733285-kz62m" event={"ID":"43c90b21-561b-432e-ae66-a7d7cfdf6c0b","Type":"ContainerDied","Data":"46dca11a2b2ed9f234983cf05f2378761d7dc3ce866584db8f56e5bedc3d6974"}
Jul 14 02:45:03.678567 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:03.678567    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a148c7-29733285-kz62m"
Jul 14 02:45:03.678746 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:03.678586    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46dca11a2b2ed9f234983cf05f2378761d7dc3ce866584db8f56e5bedc3d6974"
Jul 14 02:45:07.178368 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:07.178323    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:45:25.184863 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:25.184826    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:45:44.583248 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:44.583207    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:45:58.593422 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:45:58.593384    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:46:14.487731 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:46:14.487645    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:46:20.912755 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:46:20.912728    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:46:20.916289 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:46:20.916263    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:46:20.926481 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:46:20.926452    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:46:20.930061 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:46:20.930038    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:46:58.280589 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:46:58.280546    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:47:15.595632 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.595592    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"]
Jul 14 02:47:15.597732 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.595995    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78f62f59-9e99-4f99-b113-813a5c7c6038" containerName="cleanup"
Jul 14 02:47:15.597732 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.596006    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="78f62f59-9e99-4f99-b113-813a5c7c6038" containerName="cleanup"
Jul 14 02:47:15.597732 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.596018    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="786ee0df-9c6b-4fd0-b12d-9a71200a833f" containerName="cleanup"
Jul 14 02:47:15.597732 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.596023    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="786ee0df-9c6b-4fd0-b12d-9a71200a833f" containerName="cleanup"
Jul 14 02:47:15.597732 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.596038    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43c90b21-561b-432e-ae66-a7d7cfdf6c0b" containerName="cleanup"
Jul 14 02:47:15.597732 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.596043    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="43c90b21-561b-432e-ae66-a7d7cfdf6c0b" containerName="cleanup"
Jul 14 02:47:15.597732 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.596102    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="78f62f59-9e99-4f99-b113-813a5c7c6038" containerName="cleanup"
Jul 14 02:47:15.597732 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.596112    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="786ee0df-9c6b-4fd0-b12d-9a71200a833f" containerName="cleanup"
Jul 14 02:47:15.597732 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.596122    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="43c90b21-561b-432e-ae66-a7d7cfdf6c0b" containerName="cleanup"
Jul 14 02:47:15.598866 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.598849    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.601431 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.601404    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c47335\"/\"openshift-service-ca.crt\""
Jul 14 02:47:15.602540 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.602519    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c47335\"/\"default-dockercfg-ntnb9\""
Jul 14 02:47:15.602637 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.602563    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c47335\"/\"sub-test-model-c47335-kserve-self-signed-certs\""
Jul 14 02:47:15.602637 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.602566    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c47335\"/\"kube-root-ca.crt\""
Jul 14 02:47:15.608023 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.607999    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"]
Jul 14 02:47:15.676045 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.676002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-tmp-dir\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.676277 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.676059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-home\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.676277 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.676131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f28724ed-e305-4bfc-9cc4-35cffa95c722-tls-certs\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.676277 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.676178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-dshm\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.676277 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.676203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bbff\" (UniqueName: \"kubernetes.io/projected/f28724ed-e305-4bfc-9cc4-35cffa95c722-kube-api-access-6bbff\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.676277 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.676260    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-model-cache\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.776985 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.776938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-dshm\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.776985 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.776986    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bbff\" (UniqueName: \"kubernetes.io/projected/f28724ed-e305-4bfc-9cc4-35cffa95c722-kube-api-access-6bbff\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.777297 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.777014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-model-cache\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.777297 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.777057    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-tmp-dir\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.777297 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.777086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-home\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.777297 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.777142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f28724ed-e305-4bfc-9cc4-35cffa95c722-tls-certs\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.777559 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.777535    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-tmp-dir\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.777624 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.777587    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-model-cache\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.777667 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.777618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-home\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.779292 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.779273    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-dshm\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.779637 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.779618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f28724ed-e305-4bfc-9cc4-35cffa95c722-tls-certs\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.785218 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.785193    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bbff\" (UniqueName: \"kubernetes.io/projected/f28724ed-e305-4bfc-9cc4-35cffa95c722-kube-api-access-6bbff\") pod \"sub-test-model-c47335-kserve-c7f47c777-6975n\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") " pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:15.910004 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:15.909906    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:16.051046 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:16.051021    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"]
Jul 14 02:47:16.051884 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:47:16.051853    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf28724ed_e305_4bfc_9cc4_35cffa95c722.slice/crio-383c817a7642df72f4c69fc5df8030df46deaa31e00378300ac1ce5bc5a2328b WatchSource:0}: Error finding container 383c817a7642df72f4c69fc5df8030df46deaa31e00378300ac1ce5bc5a2328b: Status 404 returned error can't find the container with id 383c817a7642df72f4c69fc5df8030df46deaa31e00378300ac1ce5bc5a2328b
Jul 14 02:47:16.053799 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:16.053782    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 02:47:16.497617 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:16.497573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n" event={"ID":"f28724ed-e305-4bfc-9cc4-35cffa95c722","Type":"ContainerStarted","Data":"383c817a7642df72f4c69fc5df8030df46deaa31e00378300ac1ce5bc5a2328b"}
Jul 14 02:47:17.512897 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:17.512798    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n" event={"ID":"f28724ed-e305-4bfc-9cc4-35cffa95c722","Type":"ContainerStarted","Data":"98e10e57d33ce124d55d77b28eeb3f819201b66b32a36006b92c770a2d05eb05"}
Jul 14 02:47:17.528441 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:17.528376    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n" podStartSLOduration=1.453302738 podStartE2EDuration="2.52835867s" totalImagesPullingTime="1.075055932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:47:17.527430504 +0000 UTC m=+2758.210001346" watchObservedRunningTime="2026-07-14 02:47:17.52835867 +0000 UTC m=+2758.210929507"
Jul 14 02:47:20.188474 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:20.188436    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:47:25.910261 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:25.910217    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:25.910661 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:25.910274    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:25.923247 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:25.923216    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:26.580153 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:26.580116    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:47:35.684253 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:35.684212    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:47:52.976639 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:52.976552    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"]
Jul 14 02:47:57.482097 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:47:57.482044    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:48:07.997494 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:07.997447    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n" podUID="f28724ed-e305-4bfc-9cc4-35cffa95c722" containerName="main" containerID="cri-o://98e10e57d33ce124d55d77b28eeb3f819201b66b32a36006b92c770a2d05eb05" gracePeriod=45
Jul 14 02:48:08.258574 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.258497    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:48:08.358316 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.358270    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f28724ed-e305-4bfc-9cc4-35cffa95c722-tls-certs\") pod \"f28724ed-e305-4bfc-9cc4-35cffa95c722\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") "
Jul 14 02:48:08.358316 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.358325    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-model-cache\") pod \"f28724ed-e305-4bfc-9cc4-35cffa95c722\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") "
Jul 14 02:48:08.358628 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.358375    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-home\") pod \"f28724ed-e305-4bfc-9cc4-35cffa95c722\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") "
Jul 14 02:48:08.358628 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.358405    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-dshm\") pod \"f28724ed-e305-4bfc-9cc4-35cffa95c722\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") "
Jul 14 02:48:08.358628 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.358435    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-tmp-dir\") pod \"f28724ed-e305-4bfc-9cc4-35cffa95c722\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") "
Jul 14 02:48:08.358628 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.358483    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bbff\" (UniqueName: \"kubernetes.io/projected/f28724ed-e305-4bfc-9cc4-35cffa95c722-kube-api-access-6bbff\") pod \"f28724ed-e305-4bfc-9cc4-35cffa95c722\" (UID: \"f28724ed-e305-4bfc-9cc4-35cffa95c722\") "
Jul 14 02:48:08.358831 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.358650    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-model-cache" (OuterVolumeSpecName: "model-cache") pod "f28724ed-e305-4bfc-9cc4-35cffa95c722" (UID: "f28724ed-e305-4bfc-9cc4-35cffa95c722"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:48:08.358831 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.358686    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-home" (OuterVolumeSpecName: "home") pod "f28724ed-e305-4bfc-9cc4-35cffa95c722" (UID: "f28724ed-e305-4bfc-9cc4-35cffa95c722"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:48:08.358831 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.358716    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f28724ed-e305-4bfc-9cc4-35cffa95c722" (UID: "f28724ed-e305-4bfc-9cc4-35cffa95c722"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:48:08.359397 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.359368    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-model-cache\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:48:08.359397 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.359398    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-home\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:48:08.359602 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.359412    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-tmp-dir\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:48:08.361049 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.361012    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-dshm" (OuterVolumeSpecName: "dshm") pod "f28724ed-e305-4bfc-9cc4-35cffa95c722" (UID: "f28724ed-e305-4bfc-9cc4-35cffa95c722"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:48:08.368369 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.368328    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f28724ed-e305-4bfc-9cc4-35cffa95c722-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f28724ed-e305-4bfc-9cc4-35cffa95c722" (UID: "f28724ed-e305-4bfc-9cc4-35cffa95c722"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:48:08.368369 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.368343    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f28724ed-e305-4bfc-9cc4-35cffa95c722-kube-api-access-6bbff" (OuterVolumeSpecName: "kube-api-access-6bbff") pod "f28724ed-e305-4bfc-9cc4-35cffa95c722" (UID: "f28724ed-e305-4bfc-9cc4-35cffa95c722"). InnerVolumeSpecName "kube-api-access-6bbff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:48:08.460246 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.460198    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f28724ed-e305-4bfc-9cc4-35cffa95c722-tls-certs\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:48:08.460246 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.460237    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f28724ed-e305-4bfc-9cc4-35cffa95c722-dshm\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:48:08.460246 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.460251    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bbff\" (UniqueName: \"kubernetes.io/projected/f28724ed-e305-4bfc-9cc4-35cffa95c722-kube-api-access-6bbff\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:48:08.828536 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.828494    2563 generic.go:356] "Generic (PLEG): container finished" podID="f28724ed-e305-4bfc-9cc4-35cffa95c722" containerID="98e10e57d33ce124d55d77b28eeb3f819201b66b32a36006b92c770a2d05eb05" exitCode=0
Jul 14 02:48:08.828716 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.828543    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n" event={"ID":"f28724ed-e305-4bfc-9cc4-35cffa95c722","Type":"ContainerDied","Data":"98e10e57d33ce124d55d77b28eeb3f819201b66b32a36006b92c770a2d05eb05"}
Jul 14 02:48:08.828716 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.828562    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"
Jul 14 02:48:08.828716 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.828583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n" event={"ID":"f28724ed-e305-4bfc-9cc4-35cffa95c722","Type":"ContainerDied","Data":"383c817a7642df72f4c69fc5df8030df46deaa31e00378300ac1ce5bc5a2328b"}
Jul 14 02:48:08.828716 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.828605    2563 scope.go:117] "RemoveContainer" containerID="98e10e57d33ce124d55d77b28eeb3f819201b66b32a36006b92c770a2d05eb05"
Jul 14 02:48:08.842384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.842360    2563 scope.go:117] "RemoveContainer" containerID="98e10e57d33ce124d55d77b28eeb3f819201b66b32a36006b92c770a2d05eb05"
Jul 14 02:48:08.842726 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:48:08.842701    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98e10e57d33ce124d55d77b28eeb3f819201b66b32a36006b92c770a2d05eb05\": container with ID starting with 98e10e57d33ce124d55d77b28eeb3f819201b66b32a36006b92c770a2d05eb05 not found: ID does not exist" containerID="98e10e57d33ce124d55d77b28eeb3f819201b66b32a36006b92c770a2d05eb05"
Jul 14 02:48:08.842825 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.842733    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98e10e57d33ce124d55d77b28eeb3f819201b66b32a36006b92c770a2d05eb05"} err="failed to get container status \"98e10e57d33ce124d55d77b28eeb3f819201b66b32a36006b92c770a2d05eb05\": rpc error: code = NotFound desc = could not find container \"98e10e57d33ce124d55d77b28eeb3f819201b66b32a36006b92c770a2d05eb05\": container with ID starting with 98e10e57d33ce124d55d77b28eeb3f819201b66b32a36006b92c770a2d05eb05 not found: ID does not exist"
Jul 14 02:48:08.852564 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.852531    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"]
Jul 14 02:48:08.856502 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:08.856470    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c47335/sub-test-model-c47335-kserve-c7f47c777-6975n"]
Jul 14 02:48:09.856036 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:09.855999    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f28724ed-e305-4bfc-9cc4-35cffa95c722" path="/var/lib/kubelet/pods/f28724ed-e305-4bfc-9cc4-35cffa95c722/volumes"
Jul 14 02:48:24.788662 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:24.788623    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:48:39.387829 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.387786    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"]
Jul 14 02:48:39.388366 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.388223    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f28724ed-e305-4bfc-9cc4-35cffa95c722" containerName="main"
Jul 14 02:48:39.388366 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.388236    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f28724ed-e305-4bfc-9cc4-35cffa95c722" containerName="main"
Jul 14 02:48:39.388366 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.388297    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f28724ed-e305-4bfc-9cc4-35cffa95c722" containerName="main"
Jul 14 02:48:39.391538 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.391520    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.395063 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.395036    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c47335\"/\"default-dockercfg-ntnb9\""
Jul 14 02:48:39.395211 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.395064    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c47335\"/\"kube-root-ca.crt\""
Jul 14 02:48:39.395211 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.395068    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c47335\"/\"rate-test-model-c47335-kserve-self-signed-certs\""
Jul 14 02:48:39.395211 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.395105    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c47335\"/\"openshift-service-ca.crt\""
Jul 14 02:48:39.400610 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.400590    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"]
Jul 14 02:48:39.556513 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.556469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-home\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.556513 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.556513    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-dshm\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.556738 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.556540    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5vml\" (UniqueName: \"kubernetes.io/projected/689647de-f972-4853-b6d2-d80857b41308-kube-api-access-w5vml\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.556738 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.556620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/689647de-f972-4853-b6d2-d80857b41308-tls-certs\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.556738 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.556669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-model-cache\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.556844 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.556745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-tmp-dir\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.658028 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.657928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-home\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.658028 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.657969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-dshm\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.658028 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.657993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5vml\" (UniqueName: \"kubernetes.io/projected/689647de-f972-4853-b6d2-d80857b41308-kube-api-access-w5vml\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.658320 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.658044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/689647de-f972-4853-b6d2-d80857b41308-tls-certs\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.658320 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.658081    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-model-cache\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.658320 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.658130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-tmp-dir\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.658442 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.658422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-home\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.658503 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.658485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-model-cache\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.658607 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.658587    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-tmp-dir\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.660384 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.660363    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-dshm\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.660524 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.660509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/689647de-f972-4853-b6d2-d80857b41308-tls-certs\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.665816 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.665794    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5vml\" (UniqueName: \"kubernetes.io/projected/689647de-f972-4853-b6d2-d80857b41308-kube-api-access-w5vml\") pod \"rate-test-model-c47335-kserve-7c795667f-6lb5x\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") " pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.702788 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.702748    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:39.845484 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:39.845450    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"]
Jul 14 02:48:39.846654 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:48:39.846623    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod689647de_f972_4853_b6d2_d80857b41308.slice/crio-cf6bfb4b9599a224ceb84ac292a23acf4e74ab367b0694c548a6096d50af375e WatchSource:0}: Error finding container cf6bfb4b9599a224ceb84ac292a23acf4e74ab367b0694c548a6096d50af375e: Status 404 returned error can't find the container with id cf6bfb4b9599a224ceb84ac292a23acf4e74ab367b0694c548a6096d50af375e
Jul 14 02:48:40.013751 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:40.013657    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x" event={"ID":"689647de-f972-4853-b6d2-d80857b41308","Type":"ContainerStarted","Data":"86a75363b65987f3eb22994dcf1b873b8a52cb4109bfe70125a3ae08abe719c3"}
Jul 14 02:48:40.013751 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:40.013698    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x" event={"ID":"689647de-f972-4853-b6d2-d80857b41308","Type":"ContainerStarted","Data":"cf6bfb4b9599a224ceb84ac292a23acf4e74ab367b0694c548a6096d50af375e"}
Jul 14 02:48:40.032931 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:40.032875    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x" podStartSLOduration=1.032846663 podStartE2EDuration="1.032846663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:48:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:48:40.03053211 +0000 UTC m=+2840.713102946" watchObservedRunningTime="2026-07-14 02:48:40.032846663 +0000 UTC m=+2840.715417500"
Jul 14 02:48:43.994132 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:43.994094    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:48:49.703601 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:49.703559    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:49.704073 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:49.703617    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:49.716548 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:49.716516    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:50.088096 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:50.088066    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:48:59.488632 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:48:59.488580    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:49:15.680061 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:15.679965    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:49:23.378965 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:23.378930    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"]
Jul 14 02:49:24.326083 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:24.326043    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7715-140239359795632"]
Jul 14 02:49:24.329753 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:24.329734    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239359795632"
Jul 14 02:49:24.332357 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:24.332329    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-ggvdb\""
Jul 14 02:49:24.335212 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:24.335183    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7715-140239359795632"]
Jul 14 02:49:24.469578 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:24.469534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8k8p\" (UniqueName: \"kubernetes.io/projected/f962bab9-1602-4acd-b74d-03f95fc33624-kube-api-access-h8k8p\") pod \"test-curl-7715-140239359795632\" (UID: \"f962bab9-1602-4acd-b74d-03f95fc33624\") " pod="openshift-ingress/test-curl-7715-140239359795632"
Jul 14 02:49:24.570703 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:24.570658    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8k8p\" (UniqueName: \"kubernetes.io/projected/f962bab9-1602-4acd-b74d-03f95fc33624-kube-api-access-h8k8p\") pod \"test-curl-7715-140239359795632\" (UID: \"f962bab9-1602-4acd-b74d-03f95fc33624\") " pod="openshift-ingress/test-curl-7715-140239359795632"
Jul 14 02:49:24.578207 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:24.578138    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8k8p\" (UniqueName: \"kubernetes.io/projected/f962bab9-1602-4acd-b74d-03f95fc33624-kube-api-access-h8k8p\") pod \"test-curl-7715-140239359795632\" (UID: \"f962bab9-1602-4acd-b74d-03f95fc33624\") " pod="openshift-ingress/test-curl-7715-140239359795632"
Jul 14 02:49:24.640940 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:24.640899    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239359795632"
Jul 14 02:49:24.780860 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:24.780819    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7715-140239359795632"]
Jul 14 02:49:24.781792 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:49:24.781758    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf962bab9_1602_4acd_b74d_03f95fc33624.slice/crio-16ca00c1e5dec813f2a57a8923e52a5fef00fc10c206646a6b7f43a596349aa8 WatchSource:0}: Error finding container 16ca00c1e5dec813f2a57a8923e52a5fef00fc10c206646a6b7f43a596349aa8: Status 404 returned error can't find the container with id 16ca00c1e5dec813f2a57a8923e52a5fef00fc10c206646a6b7f43a596349aa8
Jul 14 02:49:25.291464 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:25.291425    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7715-140239359795632" event={"ID":"f962bab9-1602-4acd-b74d-03f95fc33624","Type":"ContainerStarted","Data":"16ca00c1e5dec813f2a57a8923e52a5fef00fc10c206646a6b7f43a596349aa8"}
Jul 14 02:49:26.299155 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:26.299118    2563 generic.go:356] "Generic (PLEG): container finished" podID="f962bab9-1602-4acd-b74d-03f95fc33624" containerID="8936b2e5b122bf60c52a1d28479876cac71b99e8a0190d48de383b6795fcf5bc" exitCode=0
Jul 14 02:49:26.299554 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:26.299160    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7715-140239359795632" event={"ID":"f962bab9-1602-4acd-b74d-03f95fc33624","Type":"ContainerDied","Data":"8936b2e5b122bf60c52a1d28479876cac71b99e8a0190d48de383b6795fcf5bc"}
Jul 14 02:49:27.451015 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.450987    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239359795632"
Jul 14 02:49:27.482917 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.482886    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7715-140239359795632_f962bab9-1602-4acd-b74d-03f95fc33624/test-curl-7715-140239359795632/0.log"
Jul 14 02:49:27.508386 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.508349    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7715-140239359795632"]
Jul 14 02:49:27.512655 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.512628    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7715-140239359795632"]
Jul 14 02:49:27.601053 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.601021    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8k8p\" (UniqueName: \"kubernetes.io/projected/f962bab9-1602-4acd-b74d-03f95fc33624-kube-api-access-h8k8p\") pod \"f962bab9-1602-4acd-b74d-03f95fc33624\" (UID: \"f962bab9-1602-4acd-b74d-03f95fc33624\") "
Jul 14 02:49:27.603298 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.603266    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f962bab9-1602-4acd-b74d-03f95fc33624-kube-api-access-h8k8p" (OuterVolumeSpecName: "kube-api-access-h8k8p") pod "f962bab9-1602-4acd-b74d-03f95fc33624" (UID: "f962bab9-1602-4acd-b74d-03f95fc33624"). InnerVolumeSpecName "kube-api-access-h8k8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:49:27.634911 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.634879    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7715-140239364846896"]
Jul 14 02:49:27.635315 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.635301    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f962bab9-1602-4acd-b74d-03f95fc33624" containerName="test-curl-7715-140239359795632"
Jul 14 02:49:27.635361 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.635317    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f962bab9-1602-4acd-b74d-03f95fc33624" containerName="test-curl-7715-140239359795632"
Jul 14 02:49:27.635402 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.635392    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f962bab9-1602-4acd-b74d-03f95fc33624" containerName="test-curl-7715-140239359795632"
Jul 14 02:49:27.638601 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.638580    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364846896"
Jul 14 02:49:27.645555 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.645527    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7715-140239364846896"]
Jul 14 02:49:27.702785 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.702741    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8k8p\" (UniqueName: \"kubernetes.io/projected/f962bab9-1602-4acd-b74d-03f95fc33624-kube-api-access-h8k8p\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:49:27.804132 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.804094    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46bt6\" (UniqueName: \"kubernetes.io/projected/6bbbd830-2b74-4153-951a-d6c7f9aec868-kube-api-access-46bt6\") pod \"test-curl-7715-140239364846896\" (UID: \"6bbbd830-2b74-4153-951a-d6c7f9aec868\") " pod="openshift-ingress/test-curl-7715-140239364846896"
Jul 14 02:49:27.855913 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.855812    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f962bab9-1602-4acd-b74d-03f95fc33624" path="/var/lib/kubelet/pods/f962bab9-1602-4acd-b74d-03f95fc33624/volumes"
Jul 14 02:49:27.904720 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.904686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46bt6\" (UniqueName: \"kubernetes.io/projected/6bbbd830-2b74-4153-951a-d6c7f9aec868-kube-api-access-46bt6\") pod \"test-curl-7715-140239364846896\" (UID: \"6bbbd830-2b74-4153-951a-d6c7f9aec868\") " pod="openshift-ingress/test-curl-7715-140239364846896"
Jul 14 02:49:27.912122 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.912090    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46bt6\" (UniqueName: \"kubernetes.io/projected/6bbbd830-2b74-4153-951a-d6c7f9aec868-kube-api-access-46bt6\") pod \"test-curl-7715-140239364846896\" (UID: \"6bbbd830-2b74-4153-951a-d6c7f9aec868\") " pod="openshift-ingress/test-curl-7715-140239364846896"
Jul 14 02:49:27.949491 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:27.949449    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364846896"
Jul 14 02:49:28.093243 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:28.093217    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7715-140239364846896"]
Jul 14 02:49:28.094043 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:49:28.094018    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bbbd830_2b74_4153_951a_d6c7f9aec868.slice/crio-0f8aa8180219f0ae1f7f71db44424e002fcc47866ed16b66eaf683a97055f3c8 WatchSource:0}: Error finding container 0f8aa8180219f0ae1f7f71db44424e002fcc47866ed16b66eaf683a97055f3c8: Status 404 returned error can't find the container with id 0f8aa8180219f0ae1f7f71db44424e002fcc47866ed16b66eaf683a97055f3c8
Jul 14 02:49:28.314710 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:28.314680    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239359795632"
Jul 14 02:49:28.314927 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:28.314707    2563 scope.go:117] "RemoveContainer" containerID="8936b2e5b122bf60c52a1d28479876cac71b99e8a0190d48de383b6795fcf5bc"
Jul 14 02:49:28.316205 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:28.316149    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7715-140239364846896" event={"ID":"6bbbd830-2b74-4153-951a-d6c7f9aec868","Type":"ContainerStarted","Data":"0f8aa8180219f0ae1f7f71db44424e002fcc47866ed16b66eaf683a97055f3c8"}
Jul 14 02:49:29.324591 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:29.324558    2563 generic.go:356] "Generic (PLEG): container finished" podID="6bbbd830-2b74-4153-951a-d6c7f9aec868" containerID="4c537c1ac2ac838de382f50e58e3bb5a076f795b5e09fbf13f9ca7f7492c804a" exitCode=0
Jul 14 02:49:29.325026 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:29.324656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7715-140239364846896" event={"ID":"6bbbd830-2b74-4153-951a-d6c7f9aec868","Type":"ContainerDied","Data":"4c537c1ac2ac838de382f50e58e3bb5a076f795b5e09fbf13f9ca7f7492c804a"}
Jul 14 02:49:30.474941 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.474903    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364846896"
Jul 14 02:49:30.483618 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.483583    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:49:30.494670 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.494643    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7715-140239364846896_6bbbd830-2b74-4153-951a-d6c7f9aec868/test-curl-7715-140239364846896/0.log"
Jul 14 02:49:30.521419 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.521384    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7715-140239364846896"]
Jul 14 02:49:30.524271 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.524246    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7715-140239364846896"]
Jul 14 02:49:30.631837 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.631734    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46bt6\" (UniqueName: \"kubernetes.io/projected/6bbbd830-2b74-4153-951a-d6c7f9aec868-kube-api-access-46bt6\") pod \"6bbbd830-2b74-4153-951a-d6c7f9aec868\" (UID: \"6bbbd830-2b74-4153-951a-d6c7f9aec868\") "
Jul 14 02:49:30.633977 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.633945    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bbbd830-2b74-4153-951a-d6c7f9aec868-kube-api-access-46bt6" (OuterVolumeSpecName: "kube-api-access-46bt6") pod "6bbbd830-2b74-4153-951a-d6c7f9aec868" (UID: "6bbbd830-2b74-4153-951a-d6c7f9aec868"). InnerVolumeSpecName "kube-api-access-46bt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:49:30.680107 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.680067    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7715-140239364968496"]
Jul 14 02:49:30.680575 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.680555    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bbbd830-2b74-4153-951a-d6c7f9aec868" containerName="test-curl-7715-140239364846896"
Jul 14 02:49:30.680672 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.680578    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bbbd830-2b74-4153-951a-d6c7f9aec868" containerName="test-curl-7715-140239364846896"
Jul 14 02:49:30.680728 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.680682    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bbbd830-2b74-4153-951a-d6c7f9aec868" containerName="test-curl-7715-140239364846896"
Jul 14 02:49:30.683643 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.683611    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364968496"
Jul 14 02:49:30.687032 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.686997    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7715-140239364968496"]
Jul 14 02:49:30.732539 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.732504    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46bt6\" (UniqueName: \"kubernetes.io/projected/6bbbd830-2b74-4153-951a-d6c7f9aec868-kube-api-access-46bt6\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:49:30.833155 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.833104    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67br8\" (UniqueName: \"kubernetes.io/projected/53fe3af2-f063-45c6-9855-080f239ca404-kube-api-access-67br8\") pod \"test-curl-7715-140239364968496\" (UID: \"53fe3af2-f063-45c6-9855-080f239ca404\") " pod="openshift-ingress/test-curl-7715-140239364968496"
Jul 14 02:49:30.934793 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.934688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67br8\" (UniqueName: \"kubernetes.io/projected/53fe3af2-f063-45c6-9855-080f239ca404-kube-api-access-67br8\") pod \"test-curl-7715-140239364968496\" (UID: \"53fe3af2-f063-45c6-9855-080f239ca404\") " pod="openshift-ingress/test-curl-7715-140239364968496"
Jul 14 02:49:30.942645 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.942610    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67br8\" (UniqueName: \"kubernetes.io/projected/53fe3af2-f063-45c6-9855-080f239ca404-kube-api-access-67br8\") pod \"test-curl-7715-140239364968496\" (UID: \"53fe3af2-f063-45c6-9855-080f239ca404\") " pod="openshift-ingress/test-curl-7715-140239364968496"
Jul 14 02:49:30.993297 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:30.993259    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364968496"
Jul 14 02:49:31.131338 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:31.131308    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7715-140239364968496"]
Jul 14 02:49:31.131918 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:49:31.131893    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53fe3af2_f063_45c6_9855_080f239ca404.slice/crio-77d804c5d9ef5d7f1934c7d19607fc45d563c2b3c421df326d740fb5e653fcc9 WatchSource:0}: Error finding container 77d804c5d9ef5d7f1934c7d19607fc45d563c2b3c421df326d740fb5e653fcc9: Status 404 returned error can't find the container with id 77d804c5d9ef5d7f1934c7d19607fc45d563c2b3c421df326d740fb5e653fcc9
Jul 14 02:49:31.339715 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:31.339685    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364846896"
Jul 14 02:49:31.339715 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:31.339720    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f8aa8180219f0ae1f7f71db44424e002fcc47866ed16b66eaf683a97055f3c8"
Jul 14 02:49:31.341080 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:31.341050    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7715-140239364968496" event={"ID":"53fe3af2-f063-45c6-9855-080f239ca404","Type":"ContainerStarted","Data":"77d804c5d9ef5d7f1934c7d19607fc45d563c2b3c421df326d740fb5e653fcc9"}
Jul 14 02:49:31.352287 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:49:31.352244    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7715-140239364846896\" is forbidden: User \"system:node:ip-10-0-129-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-135.ec2.internal' and this object" podUID="6bbbd830-2b74-4153-951a-d6c7f9aec868" pod="openshift-ingress/test-curl-7715-140239364846896"
Jul 14 02:49:31.855817 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:31.855781    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bbbd830-2b74-4153-951a-d6c7f9aec868" path="/var/lib/kubelet/pods/6bbbd830-2b74-4153-951a-d6c7f9aec868/volumes"
Jul 14 02:49:32.348496 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:32.348462    2563 generic.go:356] "Generic (PLEG): container finished" podID="53fe3af2-f063-45c6-9855-080f239ca404" containerID="dad784afd4c3e8bf29ea644d7b53c438c37e7e78c757476f313d2a17f07b7f5e" exitCode=0
Jul 14 02:49:32.348680 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:32.348549    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7715-140239364968496" event={"ID":"53fe3af2-f063-45c6-9855-080f239ca404","Type":"ContainerDied","Data":"dad784afd4c3e8bf29ea644d7b53c438c37e7e78c757476f313d2a17f07b7f5e"}
Jul 14 02:49:33.501549 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.501522    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364968496"
Jul 14 02:49:33.519834 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.519808    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7715-140239364968496_53fe3af2-f063-45c6-9855-080f239ca404/test-curl-7715-140239364968496/0.log"
Jul 14 02:49:33.545617 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.545586    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7715-140239364968496"]
Jul 14 02:49:33.548397 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.548373    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7715-140239364968496"]
Jul 14 02:49:33.555651 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.555625    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67br8\" (UniqueName: \"kubernetes.io/projected/53fe3af2-f063-45c6-9855-080f239ca404-kube-api-access-67br8\") pod \"53fe3af2-f063-45c6-9855-080f239ca404\" (UID: \"53fe3af2-f063-45c6-9855-080f239ca404\") "
Jul 14 02:49:33.557756 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.557723    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53fe3af2-f063-45c6-9855-080f239ca404-kube-api-access-67br8" (OuterVolumeSpecName: "kube-api-access-67br8") pod "53fe3af2-f063-45c6-9855-080f239ca404" (UID: "53fe3af2-f063-45c6-9855-080f239ca404"). InnerVolumeSpecName "kube-api-access-67br8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:49:33.656617 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.656533    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67br8\" (UniqueName: \"kubernetes.io/projected/53fe3af2-f063-45c6-9855-080f239ca404-kube-api-access-67br8\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:49:33.659045 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.659017    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7715-140239364968496"]
Jul 14 02:49:33.659427 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.659414    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53fe3af2-f063-45c6-9855-080f239ca404" containerName="test-curl-7715-140239364968496"
Jul 14 02:49:33.659480 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.659428    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="53fe3af2-f063-45c6-9855-080f239ca404" containerName="test-curl-7715-140239364968496"
Jul 14 02:49:33.659521 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.659510    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="53fe3af2-f063-45c6-9855-080f239ca404" containerName="test-curl-7715-140239364968496"
Jul 14 02:49:33.662793 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.662765    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364968496"
Jul 14 02:49:33.666530 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.666498    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7715-140239364968496"]
Jul 14 02:49:33.757121 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.757080    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppmkl\" (UniqueName: \"kubernetes.io/projected/8012beb8-70fe-4421-8f40-ef3e5d785135-kube-api-access-ppmkl\") pod \"test-curl-7715-140239364968496\" (UID: \"8012beb8-70fe-4421-8f40-ef3e5d785135\") " pod="openshift-ingress/test-curl-7715-140239364968496"
Jul 14 02:49:33.855726 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.855691    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53fe3af2-f063-45c6-9855-080f239ca404" path="/var/lib/kubelet/pods/53fe3af2-f063-45c6-9855-080f239ca404/volumes"
Jul 14 02:49:33.857640 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.857615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppmkl\" (UniqueName: \"kubernetes.io/projected/8012beb8-70fe-4421-8f40-ef3e5d785135-kube-api-access-ppmkl\") pod \"test-curl-7715-140239364968496\" (UID: \"8012beb8-70fe-4421-8f40-ef3e5d785135\") " pod="openshift-ingress/test-curl-7715-140239364968496"
Jul 14 02:49:33.865688 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.865665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppmkl\" (UniqueName: \"kubernetes.io/projected/8012beb8-70fe-4421-8f40-ef3e5d785135-kube-api-access-ppmkl\") pod \"test-curl-7715-140239364968496\" (UID: \"8012beb8-70fe-4421-8f40-ef3e5d785135\") " pod="openshift-ingress/test-curl-7715-140239364968496"
Jul 14 02:49:33.973369 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:33.973269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364968496"
Jul 14 02:49:34.120984 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:34.120945    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7715-140239364968496"]
Jul 14 02:49:34.362792 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:34.362759    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364968496"
Jul 14 02:49:34.362792 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:34.362774    2563 scope.go:117] "RemoveContainer" containerID="dad784afd4c3e8bf29ea644d7b53c438c37e7e78c757476f313d2a17f07b7f5e"
Jul 14 02:49:34.364286 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:34.364214    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7715-140239364968496" event={"ID":"8012beb8-70fe-4421-8f40-ef3e5d785135","Type":"ContainerStarted","Data":"940481ad4db230e6063872fc948c5bf833ad60b3ed1062f12a601f540da1db22"}
Jul 14 02:49:35.374021 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:35.373982    2563 generic.go:356] "Generic (PLEG): container finished" podID="8012beb8-70fe-4421-8f40-ef3e5d785135" containerID="909aa3c2c17451db951ea9f0aff74e89b938f6a2e09d6dcf88fd4f32686420eb" exitCode=0
Jul 14 02:49:35.374478 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:35.374064    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7715-140239364968496" event={"ID":"8012beb8-70fe-4421-8f40-ef3e5d785135","Type":"ContainerDied","Data":"909aa3c2c17451db951ea9f0aff74e89b938f6a2e09d6dcf88fd4f32686420eb"}
Jul 14 02:49:36.525878 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.525849    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364968496"
Jul 14 02:49:36.544275 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.544242    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7715-140239364968496_8012beb8-70fe-4421-8f40-ef3e5d785135/test-curl-7715-140239364968496/0.log"
Jul 14 02:49:36.569967 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.569930    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7715-140239364968496"]
Jul 14 02:49:36.572988 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.572957    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7715-140239364968496"]
Jul 14 02:49:36.582399 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.582369    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppmkl\" (UniqueName: \"kubernetes.io/projected/8012beb8-70fe-4421-8f40-ef3e5d785135-kube-api-access-ppmkl\") pod \"8012beb8-70fe-4421-8f40-ef3e5d785135\" (UID: \"8012beb8-70fe-4421-8f40-ef3e5d785135\") "
Jul 14 02:49:36.584484 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.584452    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8012beb8-70fe-4421-8f40-ef3e5d785135-kube-api-access-ppmkl" (OuterVolumeSpecName: "kube-api-access-ppmkl") pod "8012beb8-70fe-4421-8f40-ef3e5d785135" (UID: "8012beb8-70fe-4421-8f40-ef3e5d785135"). InnerVolumeSpecName "kube-api-access-ppmkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:49:36.683157 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.683054    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppmkl\" (UniqueName: \"kubernetes.io/projected/8012beb8-70fe-4421-8f40-ef3e5d785135-kube-api-access-ppmkl\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:49:36.694379 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.694343    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7715-140239364969504"]
Jul 14 02:49:36.694732 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.694720    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8012beb8-70fe-4421-8f40-ef3e5d785135" containerName="test-curl-7715-140239364968496"
Jul 14 02:49:36.694785 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.694734    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8012beb8-70fe-4421-8f40-ef3e5d785135" containerName="test-curl-7715-140239364968496"
Jul 14 02:49:36.694829 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.694820    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8012beb8-70fe-4421-8f40-ef3e5d785135" containerName="test-curl-7715-140239364968496"
Jul 14 02:49:36.697995 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.697965    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364969504"
Jul 14 02:49:36.701075 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.701051    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7715-140239364969504"]
Jul 14 02:49:36.784126 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.784082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w894d\" (UniqueName: \"kubernetes.io/projected/a5c00348-e52f-44b5-b268-1a8c15ff05b1-kube-api-access-w894d\") pod \"test-curl-7715-140239364969504\" (UID: \"a5c00348-e52f-44b5-b268-1a8c15ff05b1\") " pod="openshift-ingress/test-curl-7715-140239364969504"
Jul 14 02:49:36.885368 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.885333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w894d\" (UniqueName: \"kubernetes.io/projected/a5c00348-e52f-44b5-b268-1a8c15ff05b1-kube-api-access-w894d\") pod \"test-curl-7715-140239364969504\" (UID: \"a5c00348-e52f-44b5-b268-1a8c15ff05b1\") " pod="openshift-ingress/test-curl-7715-140239364969504"
Jul 14 02:49:36.893337 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:36.893307    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w894d\" (UniqueName: \"kubernetes.io/projected/a5c00348-e52f-44b5-b268-1a8c15ff05b1-kube-api-access-w894d\") pod \"test-curl-7715-140239364969504\" (UID: \"a5c00348-e52f-44b5-b268-1a8c15ff05b1\") " pod="openshift-ingress/test-curl-7715-140239364969504"
Jul 14 02:49:37.007845 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:37.007724    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364969504"
Jul 14 02:49:37.149022 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:37.148994    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7715-140239364969504"]
Jul 14 02:49:37.149884 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:49:37.149855    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5c00348_e52f_44b5_b268_1a8c15ff05b1.slice/crio-3938e4069a41897d0c33e6da97a238e0ca382acca1b75c86b4f0e91fac4d43cb WatchSource:0}: Error finding container 3938e4069a41897d0c33e6da97a238e0ca382acca1b75c86b4f0e91fac4d43cb: Status 404 returned error can't find the container with id 3938e4069a41897d0c33e6da97a238e0ca382acca1b75c86b4f0e91fac4d43cb
Jul 14 02:49:37.388209 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:37.388152    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7715-140239364969504" event={"ID":"a5c00348-e52f-44b5-b268-1a8c15ff05b1","Type":"ContainerStarted","Data":"3938e4069a41897d0c33e6da97a238e0ca382acca1b75c86b4f0e91fac4d43cb"}
Jul 14 02:49:37.389577 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:37.389551    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364968496"
Jul 14 02:49:37.389686 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:37.389574    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="940481ad4db230e6063872fc948c5bf833ad60b3ed1062f12a601f540da1db22"
Jul 14 02:49:37.400205 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:49:37.400160    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7715-140239364968496\" is forbidden: User \"system:node:ip-10-0-129-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-135.ec2.internal' and this object" podUID="8012beb8-70fe-4421-8f40-ef3e5d785135" pod="openshift-ingress/test-curl-7715-140239364968496"
Jul 14 02:49:37.856228 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:37.856188    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8012beb8-70fe-4421-8f40-ef3e5d785135" path="/var/lib/kubelet/pods/8012beb8-70fe-4421-8f40-ef3e5d785135/volumes"
Jul 14 02:49:38.399924 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.399883    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x" podUID="689647de-f972-4853-b6d2-d80857b41308" containerName="main" containerID="cri-o://86a75363b65987f3eb22994dcf1b873b8a52cb4109bfe70125a3ae08abe719c3" gracePeriod=45
Jul 14 02:49:38.401548 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.401522    2563 generic.go:356] "Generic (PLEG): container finished" podID="a5c00348-e52f-44b5-b268-1a8c15ff05b1" containerID="c589fb1d22ff783a1f584c9a57e3a1748b9ff7e1282a8866141b5f3bef7d253d" exitCode=0
Jul 14 02:49:38.401665 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.401606    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7715-140239364969504" event={"ID":"a5c00348-e52f-44b5-b268-1a8c15ff05b1","Type":"ContainerDied","Data":"c589fb1d22ff783a1f584c9a57e3a1748b9ff7e1282a8866141b5f3bef7d253d"}
Jul 14 02:49:38.653229 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.653141    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:49:38.700234 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.700202    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-model-cache\") pod \"689647de-f972-4853-b6d2-d80857b41308\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") "
Jul 14 02:49:38.700391 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.700251    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-dshm\") pod \"689647de-f972-4853-b6d2-d80857b41308\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") "
Jul 14 02:49:38.700391 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.700289    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-home\") pod \"689647de-f972-4853-b6d2-d80857b41308\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") "
Jul 14 02:49:38.700391 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.700314    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5vml\" (UniqueName: \"kubernetes.io/projected/689647de-f972-4853-b6d2-d80857b41308-kube-api-access-w5vml\") pod \"689647de-f972-4853-b6d2-d80857b41308\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") "
Jul 14 02:49:38.700391 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.700365    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-tmp-dir\") pod \"689647de-f972-4853-b6d2-d80857b41308\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") "
Jul 14 02:49:38.700391 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.700389    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/689647de-f972-4853-b6d2-d80857b41308-tls-certs\") pod \"689647de-f972-4853-b6d2-d80857b41308\" (UID: \"689647de-f972-4853-b6d2-d80857b41308\") "
Jul 14 02:49:38.700671 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.700562    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-model-cache" (OuterVolumeSpecName: "model-cache") pod "689647de-f972-4853-b6d2-d80857b41308" (UID: "689647de-f972-4853-b6d2-d80857b41308"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:49:38.700671 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.700653    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-home" (OuterVolumeSpecName: "home") pod "689647de-f972-4853-b6d2-d80857b41308" (UID: "689647de-f972-4853-b6d2-d80857b41308"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:49:38.700784 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.700667    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "689647de-f972-4853-b6d2-d80857b41308" (UID: "689647de-f972-4853-b6d2-d80857b41308"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:49:38.700784 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.700769    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-model-cache\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:49:38.700885 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.700788    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-home\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:49:38.700885 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.700803    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-tmp-dir\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:49:38.702520 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.702491    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-dshm" (OuterVolumeSpecName: "dshm") pod "689647de-f972-4853-b6d2-d80857b41308" (UID: "689647de-f972-4853-b6d2-d80857b41308"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 02:49:38.702632 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.702526    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/689647de-f972-4853-b6d2-d80857b41308-kube-api-access-w5vml" (OuterVolumeSpecName: "kube-api-access-w5vml") pod "689647de-f972-4853-b6d2-d80857b41308" (UID: "689647de-f972-4853-b6d2-d80857b41308"). InnerVolumeSpecName "kube-api-access-w5vml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:49:38.702632 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.702578    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/689647de-f972-4853-b6d2-d80857b41308-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "689647de-f972-4853-b6d2-d80857b41308" (UID: "689647de-f972-4853-b6d2-d80857b41308"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 02:49:38.801488 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.801429    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/689647de-f972-4853-b6d2-d80857b41308-tls-certs\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:49:38.801488 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.801478    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/689647de-f972-4853-b6d2-d80857b41308-dshm\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:49:38.801488 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:38.801489    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5vml\" (UniqueName: \"kubernetes.io/projected/689647de-f972-4853-b6d2-d80857b41308-kube-api-access-w5vml\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:49:39.408538 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.408500    2563 generic.go:356] "Generic (PLEG): container finished" podID="689647de-f972-4853-b6d2-d80857b41308" containerID="86a75363b65987f3eb22994dcf1b873b8a52cb4109bfe70125a3ae08abe719c3" exitCode=0
Jul 14 02:49:39.408986 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.408565    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x" event={"ID":"689647de-f972-4853-b6d2-d80857b41308","Type":"ContainerDied","Data":"86a75363b65987f3eb22994dcf1b873b8a52cb4109bfe70125a3ae08abe719c3"}
Jul 14 02:49:39.408986 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.408607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x" event={"ID":"689647de-f972-4853-b6d2-d80857b41308","Type":"ContainerDied","Data":"cf6bfb4b9599a224ceb84ac292a23acf4e74ab367b0694c548a6096d50af375e"}
Jul 14 02:49:39.408986 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.408624    2563 scope.go:117] "RemoveContainer" containerID="86a75363b65987f3eb22994dcf1b873b8a52cb4109bfe70125a3ae08abe719c3"
Jul 14 02:49:39.408986 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.408625    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"
Jul 14 02:49:39.419457 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.419432    2563 scope.go:117] "RemoveContainer" containerID="86a75363b65987f3eb22994dcf1b873b8a52cb4109bfe70125a3ae08abe719c3"
Jul 14 02:49:39.419821 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:49:39.419791    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86a75363b65987f3eb22994dcf1b873b8a52cb4109bfe70125a3ae08abe719c3\": container with ID starting with 86a75363b65987f3eb22994dcf1b873b8a52cb4109bfe70125a3ae08abe719c3 not found: ID does not exist" containerID="86a75363b65987f3eb22994dcf1b873b8a52cb4109bfe70125a3ae08abe719c3"
Jul 14 02:49:39.419953 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.419831    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86a75363b65987f3eb22994dcf1b873b8a52cb4109bfe70125a3ae08abe719c3"} err="failed to get container status \"86a75363b65987f3eb22994dcf1b873b8a52cb4109bfe70125a3ae08abe719c3\": rpc error: code = NotFound desc = could not find container \"86a75363b65987f3eb22994dcf1b873b8a52cb4109bfe70125a3ae08abe719c3\": container with ID starting with 86a75363b65987f3eb22994dcf1b873b8a52cb4109bfe70125a3ae08abe719c3 not found: ID does not exist"
Jul 14 02:49:39.432314 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.432282    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"]
Jul 14 02:49:39.435187 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.435145    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c47335/rate-test-model-c47335-kserve-7c795667f-6lb5x"]
Jul 14 02:49:39.550913 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.550886    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364969504"
Jul 14 02:49:39.570764 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.570739    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7715-140239364969504_a5c00348-e52f-44b5-b268-1a8c15ff05b1/test-curl-7715-140239364969504/0.log"
Jul 14 02:49:39.600718 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.600688    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7715-140239364969504"]
Jul 14 02:49:39.603448 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.603422    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7715-140239364969504"]
Jul 14 02:49:39.608790 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.608762    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w894d\" (UniqueName: \"kubernetes.io/projected/a5c00348-e52f-44b5-b268-1a8c15ff05b1-kube-api-access-w894d\") pod \"a5c00348-e52f-44b5-b268-1a8c15ff05b1\" (UID: \"a5c00348-e52f-44b5-b268-1a8c15ff05b1\") "
Jul 14 02:49:39.610916 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.610890    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5c00348-e52f-44b5-b268-1a8c15ff05b1-kube-api-access-w894d" (OuterVolumeSpecName: "kube-api-access-w894d") pod "a5c00348-e52f-44b5-b268-1a8c15ff05b1" (UID: "a5c00348-e52f-44b5-b268-1a8c15ff05b1"). InnerVolumeSpecName "kube-api-access-w894d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:49:39.709667 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.709573    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w894d\" (UniqueName: \"kubernetes.io/projected/a5c00348-e52f-44b5-b268-1a8c15ff05b1-kube-api-access-w894d\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:49:39.722313 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.722274    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7715-140239364969504"]
Jul 14 02:49:39.722687 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.722673    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5c00348-e52f-44b5-b268-1a8c15ff05b1" containerName="test-curl-7715-140239364969504"
Jul 14 02:49:39.722729 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.722689    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5c00348-e52f-44b5-b268-1a8c15ff05b1" containerName="test-curl-7715-140239364969504"
Jul 14 02:49:39.722729 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.722698    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="689647de-f972-4853-b6d2-d80857b41308" containerName="main"
Jul 14 02:49:39.722729 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.722704    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="689647de-f972-4853-b6d2-d80857b41308" containerName="main"
Jul 14 02:49:39.722823 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.722769    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="689647de-f972-4853-b6d2-d80857b41308" containerName="main"
Jul 14 02:49:39.722823 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.722778    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5c00348-e52f-44b5-b268-1a8c15ff05b1" containerName="test-curl-7715-140239364969504"
Jul 14 02:49:39.725965 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.725937    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364969504"
Jul 14 02:49:39.729501 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.729473    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7715-140239364969504"]
Jul 14 02:49:39.810619 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.810578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96jbf\" (UniqueName: \"kubernetes.io/projected/d2df7600-89a4-4e06-9e31-c435c8dc9a0c-kube-api-access-96jbf\") pod \"test-curl-7715-140239364969504\" (UID: \"d2df7600-89a4-4e06-9e31-c435c8dc9a0c\") " pod="openshift-ingress/test-curl-7715-140239364969504"
Jul 14 02:49:39.855406 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.855365    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="689647de-f972-4853-b6d2-d80857b41308" path="/var/lib/kubelet/pods/689647de-f972-4853-b6d2-d80857b41308/volumes"
Jul 14 02:49:39.855723 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.855710    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5c00348-e52f-44b5-b268-1a8c15ff05b1" path="/var/lib/kubelet/pods/a5c00348-e52f-44b5-b268-1a8c15ff05b1/volumes"
Jul 14 02:49:39.911439 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.911399    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96jbf\" (UniqueName: \"kubernetes.io/projected/d2df7600-89a4-4e06-9e31-c435c8dc9a0c-kube-api-access-96jbf\") pod \"test-curl-7715-140239364969504\" (UID: \"d2df7600-89a4-4e06-9e31-c435c8dc9a0c\") " pod="openshift-ingress/test-curl-7715-140239364969504"
Jul 14 02:49:39.919620 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:39.919587    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96jbf\" (UniqueName: \"kubernetes.io/projected/d2df7600-89a4-4e06-9e31-c435c8dc9a0c-kube-api-access-96jbf\") pod \"test-curl-7715-140239364969504\" (UID: \"d2df7600-89a4-4e06-9e31-c435c8dc9a0c\") " pod="openshift-ingress/test-curl-7715-140239364969504"
Jul 14 02:49:40.036064 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:40.035953    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364969504"
Jul 14 02:49:40.176456 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:40.176426    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7715-140239364969504"]
Jul 14 02:49:40.177565 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:49:40.177540    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2df7600_89a4_4e06_9e31_c435c8dc9a0c.slice/crio-2e587ac26a799e3dc25dfb49782bf9d5311a6be69baa4be385f04c55f1ee78cc WatchSource:0}: Error finding container 2e587ac26a799e3dc25dfb49782bf9d5311a6be69baa4be385f04c55f1ee78cc: Status 404 returned error can't find the container with id 2e587ac26a799e3dc25dfb49782bf9d5311a6be69baa4be385f04c55f1ee78cc
Jul 14 02:49:40.417356 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:40.417307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7715-140239364969504" event={"ID":"d2df7600-89a4-4e06-9e31-c435c8dc9a0c","Type":"ContainerStarted","Data":"2e587ac26a799e3dc25dfb49782bf9d5311a6be69baa4be385f04c55f1ee78cc"}
Jul 14 02:49:40.418738 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:40.418716    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364969504"
Jul 14 02:49:40.418855 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:40.418756    2563 scope.go:117] "RemoveContainer" containerID="c589fb1d22ff783a1f584c9a57e3a1748b9ff7e1282a8866141b5f3bef7d253d"
Jul 14 02:49:41.426665 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:41.426622    2563 generic.go:356] "Generic (PLEG): container finished" podID="d2df7600-89a4-4e06-9e31-c435c8dc9a0c" containerID="eda88adb7e5d778d9bb231f87fd73ed2282ce9ae897a7eb7bed9085845c53c4a" exitCode=0
Jul 14 02:49:41.427078 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:41.426707    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7715-140239364969504" event={"ID":"d2df7600-89a4-4e06-9e31-c435c8dc9a0c","Type":"ContainerDied","Data":"eda88adb7e5d778d9bb231f87fd73ed2282ce9ae897a7eb7bed9085845c53c4a"}
Jul 14 02:49:42.578870 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.578839    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364969504"
Jul 14 02:49:42.597884 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.597858    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7715-140239364969504_d2df7600-89a4-4e06-9e31-c435c8dc9a0c/test-curl-7715-140239364969504/0.log"
Jul 14 02:49:42.622745 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.622705    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7715-140239364969504"]
Jul 14 02:49:42.626453 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.626419    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7715-140239364969504"]
Jul 14 02:49:42.635651 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.635626    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96jbf\" (UniqueName: \"kubernetes.io/projected/d2df7600-89a4-4e06-9e31-c435c8dc9a0c-kube-api-access-96jbf\") pod \"d2df7600-89a4-4e06-9e31-c435c8dc9a0c\" (UID: \"d2df7600-89a4-4e06-9e31-c435c8dc9a0c\") "
Jul 14 02:49:42.637749 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.637722    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2df7600-89a4-4e06-9e31-c435c8dc9a0c-kube-api-access-96jbf" (OuterVolumeSpecName: "kube-api-access-96jbf") pod "d2df7600-89a4-4e06-9e31-c435c8dc9a0c" (UID: "d2df7600-89a4-4e06-9e31-c435c8dc9a0c"). InnerVolumeSpecName "kube-api-access-96jbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 02:49:42.736742 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.736633    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96jbf\" (UniqueName: \"kubernetes.io/projected/d2df7600-89a4-4e06-9e31-c435c8dc9a0c-kube-api-access-96jbf\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:49:42.806562 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.803662    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d"]
Jul 14 02:49:42.806562 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.804584    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2df7600-89a4-4e06-9e31-c435c8dc9a0c" containerName="test-curl-7715-140239364969504"
Jul 14 02:49:42.806562 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.804608    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2df7600-89a4-4e06-9e31-c435c8dc9a0c" containerName="test-curl-7715-140239364969504"
Jul 14 02:49:42.806562 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.804786    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2df7600-89a4-4e06-9e31-c435c8dc9a0c" containerName="test-curl-7715-140239364969504"
Jul 14 02:49:42.809026 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.808997    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d"
Jul 14 02:49:42.811553 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.811526    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:49:42.811677 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.811569    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:49:42.812465 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.812436    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d"]
Jul 14 02:49:42.837119 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.837078    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb83ed5-fd7e-49a1-a78a-883280d227ef-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d\" (UID: \"3eb83ed5-fd7e-49a1-a78a-883280d227ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d"
Jul 14 02:49:42.938153 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.938093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb83ed5-fd7e-49a1-a78a-883280d227ef-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d\" (UID: \"3eb83ed5-fd7e-49a1-a78a-883280d227ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d"
Jul 14 02:49:42.938775 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:42.938755    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb83ed5-fd7e-49a1-a78a-883280d227ef-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d\" (UID: \"3eb83ed5-fd7e-49a1-a78a-883280d227ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d"
Jul 14 02:49:43.121270 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:43.121228    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d"
Jul 14 02:49:43.260924 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:43.260893    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d"]
Jul 14 02:49:43.262179 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:49:43.262141    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb83ed5_fd7e_49a1_a78a_883280d227ef.slice/crio-920a7c224d41b3b034c071b25772f14bdbd1343b8efbdcc02c533a1d4bdf487e WatchSource:0}: Error finding container 920a7c224d41b3b034c071b25772f14bdbd1343b8efbdcc02c533a1d4bdf487e: Status 404 returned error can't find the container with id 920a7c224d41b3b034c071b25772f14bdbd1343b8efbdcc02c533a1d4bdf487e
Jul 14 02:49:43.441828 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:43.441798    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7715-140239364969504"
Jul 14 02:49:43.442043 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:43.441833    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e587ac26a799e3dc25dfb49782bf9d5311a6be69baa4be385f04c55f1ee78cc"
Jul 14 02:49:43.443227 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:43.443198    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d" event={"ID":"3eb83ed5-fd7e-49a1-a78a-883280d227ef","Type":"ContainerStarted","Data":"920a7c224d41b3b034c071b25772f14bdbd1343b8efbdcc02c533a1d4bdf487e"}
Jul 14 02:49:43.452331 ip-10-0-129-135 kubenswrapper[2563]: E0714 02:49:43.452301    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7715-140239364969504\" is forbidden: User \"system:node:ip-10-0-129-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-135.ec2.internal' and this object" podUID="d2df7600-89a4-4e06-9e31-c435c8dc9a0c" pod="openshift-ingress/test-curl-7715-140239364969504"
Jul 14 02:49:43.855931 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:43.855897    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2df7600-89a4-4e06-9e31-c435c8dc9a0c" path="/var/lib/kubelet/pods/d2df7600-89a4-4e06-9e31-c435c8dc9a0c/volumes"
Jul 14 02:49:44.451472 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:44.451437    2563 generic.go:356] "Generic (PLEG): container finished" podID="3eb83ed5-fd7e-49a1-a78a-883280d227ef" containerID="bc8ea6100fd7f7aa6c4579dbfaa8808ddb5d5a36030a60a16ac8b6e0aaf1390b" exitCode=0
Jul 14 02:49:44.451634 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:44.451522    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d" event={"ID":"3eb83ed5-fd7e-49a1-a78a-883280d227ef","Type":"ContainerDied","Data":"bc8ea6100fd7f7aa6c4579dbfaa8808ddb5d5a36030a60a16ac8b6e0aaf1390b"}
Jul 14 02:49:45.592964 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:45.592939    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d"
Jul 14 02:49:45.662616 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:45.662572    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb83ed5-fd7e-49a1-a78a-883280d227ef-maas-api-service-ca\") pod \"3eb83ed5-fd7e-49a1-a78a-883280d227ef\" (UID: \"3eb83ed5-fd7e-49a1-a78a-883280d227ef\") "
Jul 14 02:49:45.662961 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:45.662937    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb83ed5-fd7e-49a1-a78a-883280d227ef-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3eb83ed5-fd7e-49a1-a78a-883280d227ef" (UID: "3eb83ed5-fd7e-49a1-a78a-883280d227ef"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:49:45.763649 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:45.763552    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb83ed5-fd7e-49a1-a78a-883280d227ef-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:49:46.466636 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:46.466608    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d"
Jul 14 02:49:46.466819 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:46.466651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d" event={"ID":"3eb83ed5-fd7e-49a1-a78a-883280d227ef","Type":"ContainerDied","Data":"920a7c224d41b3b034c071b25772f14bdbd1343b8efbdcc02c533a1d4bdf487e"}
Jul 14 02:49:46.466819 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:46.466701    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="920a7c224d41b3b034c071b25772f14bdbd1343b8efbdcc02c533a1d4bdf487e"
Jul 14 02:49:53.187284 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:53.187237    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a148c7-29733285-kz62m"]
Jul 14 02:49:53.190372 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:53.190339    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-a148c7-29733285-kz62m"]
Jul 14 02:49:53.855956 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:53.855921    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43c90b21-561b-432e-ae66-a7d7cfdf6c0b" path="/var/lib/kubelet/pods/43c90b21-561b-432e-ae66-a7d7cfdf6c0b/volumes"
Jul 14 02:49:56.986398 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:49:56.986361    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:50:08.914631 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:08.914592    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6"]
Jul 14 02:50:08.915024 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:08.915010    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb83ed5-fd7e-49a1-a78a-883280d227ef" containerName="revoke-keys"
Jul 14 02:50:08.915024 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:08.915025    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb83ed5-fd7e-49a1-a78a-883280d227ef" containerName="revoke-keys"
Jul 14 02:50:08.915117 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:08.915108    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb83ed5-fd7e-49a1-a78a-883280d227ef" containerName="revoke-keys"
Jul 14 02:50:08.918240 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:08.918219    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6"
Jul 14 02:50:08.920996 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:08.920970    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wk67\""
Jul 14 02:50:08.921876 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:08.921847    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 02:50:08.924438 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:08.924411    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6"]
Jul 14 02:50:08.990719 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:08.990685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4c7cb22-55d7-405f-b507-e1dd12d304f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6\" (UID: \"a4c7cb22-55d7-405f-b507-e1dd12d304f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6"
Jul 14 02:50:09.091621 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:09.091581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4c7cb22-55d7-405f-b507-e1dd12d304f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6\" (UID: \"a4c7cb22-55d7-405f-b507-e1dd12d304f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6"
Jul 14 02:50:09.092252 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:09.092233    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4c7cb22-55d7-405f-b507-e1dd12d304f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6\" (UID: \"a4c7cb22-55d7-405f-b507-e1dd12d304f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6"
Jul 14 02:50:09.231113 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:09.231020    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6"
Jul 14 02:50:09.382768 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:09.382736    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6"]
Jul 14 02:50:09.384031 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:50:09.384001    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c7cb22_55d7_405f_b507_e1dd12d304f5.slice/crio-847541b72c30e26e37a0805631132d2f1a607c23d699e39d11c2e80275ed0e8b WatchSource:0}: Error finding container 847541b72c30e26e37a0805631132d2f1a607c23d699e39d11c2e80275ed0e8b: Status 404 returned error can't find the container with id 847541b72c30e26e37a0805631132d2f1a607c23d699e39d11c2e80275ed0e8b
Jul 14 02:50:09.620390 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:09.620354    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6" event={"ID":"a4c7cb22-55d7-405f-b507-e1dd12d304f5","Type":"ContainerStarted","Data":"847541b72c30e26e37a0805631132d2f1a607c23d699e39d11c2e80275ed0e8b"}
Jul 14 02:50:10.633353 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:10.633316    2563 generic.go:356] "Generic (PLEG): container finished" podID="a4c7cb22-55d7-405f-b507-e1dd12d304f5" containerID="1db1ae049d02b850be0b1e8af0c6a47b8bff21dfb6b7ea97d6f52dc1d67ba1f5" exitCode=0
Jul 14 02:50:10.633766 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:10.633408    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6" event={"ID":"a4c7cb22-55d7-405f-b507-e1dd12d304f5","Type":"ContainerDied","Data":"1db1ae049d02b850be0b1e8af0c6a47b8bff21dfb6b7ea97d6f52dc1d67ba1f5"}
Jul 14 02:50:11.773630 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:11.773601    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6"
Jul 14 02:50:11.913301 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:11.913198    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4c7cb22-55d7-405f-b507-e1dd12d304f5-maas-api-service-ca\") pod \"a4c7cb22-55d7-405f-b507-e1dd12d304f5\" (UID: \"a4c7cb22-55d7-405f-b507-e1dd12d304f5\") "
Jul 14 02:50:11.913584 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:11.913562    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4c7cb22-55d7-405f-b507-e1dd12d304f5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4c7cb22-55d7-405f-b507-e1dd12d304f5" (UID: "a4c7cb22-55d7-405f-b507-e1dd12d304f5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 02:50:12.014487 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:12.014441    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4c7cb22-55d7-405f-b507-e1dd12d304f5-maas-api-service-ca\") on node \"ip-10-0-129-135.ec2.internal\" DevicePath \"\""
Jul 14 02:50:12.647446 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:12.647414    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6"
Jul 14 02:50:12.647656 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:12.647457    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6" event={"ID":"a4c7cb22-55d7-405f-b507-e1dd12d304f5","Type":"ContainerDied","Data":"847541b72c30e26e37a0805631132d2f1a607c23d699e39d11c2e80275ed0e8b"}
Jul 14 02:50:12.647656 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:12.647507    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="847541b72c30e26e37a0805631132d2f1a607c23d699e39d11c2e80275ed0e8b"
Jul 14 02:50:19.253793 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:19.253752    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c47335-29733285-rrlvg"]
Jul 14 02:50:19.256574 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:19.256548    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-c47335-29733285-rrlvg"]
Jul 14 02:50:19.858929 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:19.858885    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="786ee0df-9c6b-4fd0-b12d-9a71200a833f" path="/var/lib/kubelet/pods/786ee0df-9c6b-4fd0-b12d-9a71200a833f/volumes"
Jul 14 02:50:22.582452 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:22.582417    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cn79h"]
Jul 14 02:50:35.321414 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:35.321378    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-ffb6789c8-wr5qt_01b26d5e-265a-4ce1-aaea-d27c20121657/authorino/0.log"
Jul 14 02:50:40.871687 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:40.871655    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5756559977-m8jzc_36dce243-e020-4321-b331-28b7fadfdf14/copy-manifests/0.log"
Jul 14 02:50:40.878331 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:40.878294    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5756559977-m8jzc_36dce243-e020-4321-b331-28b7fadfdf14/manager/0.log"
Jul 14 02:50:41.475125 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:41.475093    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29733255-cr9pf_3dc35534-9be6-4033-a0f7-e12eea54ef79/cleanup/0.log"
Jul 14 02:50:41.589223 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:41.589185    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29733270-dmzx8_d23b59ca-ca4f-4c55-97bc-71cbd286ee9b/cleanup/0.log"
Jul 14 02:50:41.697458 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:41.697428    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29733285-r256z_78f62f59-9e99-4f99-b113-813a5c7c6038/cleanup/0.log"
Jul 14 02:50:41.807451 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:41.807319    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-4535243d-trsd5_dc4db398-cb9f-4bc5-b781-0decab645e99/revoke-keys/0.log"
Jul 14 02:50:41.911052 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:41.911021    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-b25e0f88-68b9m_f0b6a396-ba96-4262-ae87-fad7bf08436b/revoke-keys/0.log"
Jul 14 02:50:42.018409 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:42.018378    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-9794b6-76bpg_55c3e9d6-fb94-4152-b291-9021f279f282/revoke-keys/0.log"
Jul 14 02:50:42.127682 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:42.127647    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-f83e72-5mtl4_92fd94ec-baa0-412e-804f-3801c2f4bb59/revoke-keys/0.log"
Jul 14 02:50:42.239950 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:42.239923    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-a5aba0cb-n4b6l_97c6be93-5f1c-447d-a772-5e82e0e0def6/revoke-keys/0.log"
Jul 14 02:50:42.354471 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:42.354444    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-cc2dba-8pknk_89cae796-3459-4b4c-8d6a-101abbfd58d3/revoke-keys/0.log"
Jul 14 02:50:42.463154 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:42.463059    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-7924bc-69ddx_29ad3739-211b-453e-92ce-d0b5b793e696/revoke-keys/0.log"
Jul 14 02:50:42.570553 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:42.570516    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-fc424a89-4xdnk_43b21a52-0671-48c7-b4ca-8b779ba79436/revoke-keys/0.log"
Jul 14 02:50:42.682683 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:42.682647    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-c40b4277-d2rjb_284758f4-26a3-477a-8195-19f709b74c8d/revoke-keys/0.log"
Jul 14 02:50:42.793846 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:42.793774    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-ca6f969a-wgt9m_156ccf49-b0da-4a61-9872-7e56a2bc9e59/revoke-keys/0.log"
Jul 14 02:50:42.906214 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:42.906181    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-a148c7-z4p4d_3eb83ed5-fd7e-49a1-a78a-883280d227ef/revoke-keys/0.log"
Jul 14 02:50:43.019617 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:43.019588    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-c47335-pvgh6_a4c7cb22-55d7-405f-b507-e1dd12d304f5/revoke-keys/0.log"
Jul 14 02:50:43.902473 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:43.902445    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb_90ace907-c5e9-4596-917d-a5d4a546ad21/util/0.log"
Jul 14 02:50:43.908654 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:43.908631    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb_90ace907-c5e9-4596-917d-a5d4a546ad21/pull/0.log"
Jul 14 02:50:43.914498 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:43.914474    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb_90ace907-c5e9-4596-917d-a5d4a546ad21/extract/0.log"
Jul 14 02:50:44.023530 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:44.023502    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc_fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92/util/0.log"
Jul 14 02:50:44.029137 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:44.029109    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc_fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92/pull/0.log"
Jul 14 02:50:44.038993 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:44.038970    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc_fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92/extract/0.log"
Jul 14 02:50:44.151901 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:44.151872    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88_729913af-5015-4678-abb1-15b74734d779/util/0.log"
Jul 14 02:50:44.157110 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:44.157033    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88_729913af-5015-4678-abb1-15b74734d779/pull/0.log"
Jul 14 02:50:44.162399 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:44.162375    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88_729913af-5015-4678-abb1-15b74734d779/extract/0.log"
Jul 14 02:50:44.271008 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:44.270979    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s_392f2074-5af1-4066-be7d-87f972017981/util/0.log"
Jul 14 02:50:44.276516 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:44.276487    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s_392f2074-5af1-4066-be7d-87f972017981/pull/0.log"
Jul 14 02:50:44.281905 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:44.281877    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s_392f2074-5af1-4066-be7d-87f972017981/extract/0.log"
Jul 14 02:50:44.395801 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:44.395770    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-ffb6789c8-wr5qt_01b26d5e-265a-4ce1-aaea-d27c20121657/authorino/0.log"
Jul 14 02:50:44.741300 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:44.741270    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9l57d_2aa3164b-a1fb-4963-880a-c136f37c7850/kuadrant-console-plugin/0.log"
Jul 14 02:50:45.087528 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:45.087495    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-cn79h_ad70e053-7228-4854-9303-bd9be426197a/limitador/0.log"
Jul 14 02:50:45.795132 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:45.795104    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69dd74468c-7mnrs_1f3942ae-267c-40d9-96ea-171903468426/kube-auth-proxy/0.log"
Jul 14 02:50:51.791673 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:51.791636    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-btqq2/must-gather-6q6fs"]
Jul 14 02:50:51.792058 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:51.792003    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c7cb22-55d7-405f-b507-e1dd12d304f5" containerName="revoke-keys"
Jul 14 02:50:51.792058 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:51.792014    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c7cb22-55d7-405f-b507-e1dd12d304f5" containerName="revoke-keys"
Jul 14 02:50:51.792131 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:51.792093    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4c7cb22-55d7-405f-b507-e1dd12d304f5" containerName="revoke-keys"
Jul 14 02:50:51.795438 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:51.795421    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-btqq2/must-gather-6q6fs"
Jul 14 02:50:51.798376 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:51.798355    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-btqq2\"/\"openshift-service-ca.crt\""
Jul 14 02:50:51.798483 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:51.798360    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-btqq2\"/\"kube-root-ca.crt\""
Jul 14 02:50:51.805119 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:51.805095    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-btqq2/must-gather-6q6fs"]
Jul 14 02:50:51.874706 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:51.874668    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/300c9a91-8111-4cf0-a478-58db40f41b45-must-gather-output\") pod \"must-gather-6q6fs\" (UID: \"300c9a91-8111-4cf0-a478-58db40f41b45\") " pod="openshift-must-gather-btqq2/must-gather-6q6fs"
Jul 14 02:50:51.874897 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:51.874791    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv2gd\" (UniqueName: \"kubernetes.io/projected/300c9a91-8111-4cf0-a478-58db40f41b45-kube-api-access-xv2gd\") pod \"must-gather-6q6fs\" (UID: \"300c9a91-8111-4cf0-a478-58db40f41b45\") " pod="openshift-must-gather-btqq2/must-gather-6q6fs"
Jul 14 02:50:51.975784 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:51.975744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv2gd\" (UniqueName: \"kubernetes.io/projected/300c9a91-8111-4cf0-a478-58db40f41b45-kube-api-access-xv2gd\") pod \"must-gather-6q6fs\" (UID: \"300c9a91-8111-4cf0-a478-58db40f41b45\") " pod="openshift-must-gather-btqq2/must-gather-6q6fs"
Jul 14 02:50:51.975997 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:51.975833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/300c9a91-8111-4cf0-a478-58db40f41b45-must-gather-output\") pod \"must-gather-6q6fs\" (UID: \"300c9a91-8111-4cf0-a478-58db40f41b45\") " pod="openshift-must-gather-btqq2/must-gather-6q6fs"
Jul 14 02:50:51.976252 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:51.976229    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/300c9a91-8111-4cf0-a478-58db40f41b45-must-gather-output\") pod \"must-gather-6q6fs\" (UID: \"300c9a91-8111-4cf0-a478-58db40f41b45\") " pod="openshift-must-gather-btqq2/must-gather-6q6fs"
Jul 14 02:50:51.983704 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:51.983674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv2gd\" (UniqueName: \"kubernetes.io/projected/300c9a91-8111-4cf0-a478-58db40f41b45-kube-api-access-xv2gd\") pod \"must-gather-6q6fs\" (UID: \"300c9a91-8111-4cf0-a478-58db40f41b45\") " pod="openshift-must-gather-btqq2/must-gather-6q6fs"
Jul 14 02:50:52.105907 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:52.105878    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-btqq2/must-gather-6q6fs"
Jul 14 02:50:52.247757 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:52.247726    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-btqq2/must-gather-6q6fs"]
Jul 14 02:50:52.249071 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:50:52.249040    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod300c9a91_8111_4cf0_a478_58db40f41b45.slice/crio-0a1cb8338831671cee19d325c6147b9215a6a000dae6230045beb347c777ca04 WatchSource:0}: Error finding container 0a1cb8338831671cee19d325c6147b9215a6a000dae6230045beb347c777ca04: Status 404 returned error can't find the container with id 0a1cb8338831671cee19d325c6147b9215a6a000dae6230045beb347c777ca04
Jul 14 02:50:52.898912 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:52.898872    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btqq2/must-gather-6q6fs" event={"ID":"300c9a91-8111-4cf0-a478-58db40f41b45","Type":"ContainerStarted","Data":"0a1cb8338831671cee19d325c6147b9215a6a000dae6230045beb347c777ca04"}
Jul 14 02:50:53.910613 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:53.910569    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btqq2/must-gather-6q6fs" event={"ID":"300c9a91-8111-4cf0-a478-58db40f41b45","Type":"ContainerStarted","Data":"ce3090a32083607a0bc2e7d3df5d9977f10c0dcdac081062621e5b74120b814f"}
Jul 14 02:50:53.910613 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:53.910628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btqq2/must-gather-6q6fs" event={"ID":"300c9a91-8111-4cf0-a478-58db40f41b45","Type":"ContainerStarted","Data":"9eb8f820ed5cb139b5d73cc7ad0ced493b977e5361b8811d60b2bf927b3f443a"}
Jul 14 02:50:53.925990 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:53.925932    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-btqq2/must-gather-6q6fs" podStartSLOduration=2.11614834 podStartE2EDuration="2.925915243s" totalImagesPullingTime="809.766903ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 02:50:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:50:53.92446829 +0000 UTC m=+2974.607039134" watchObservedRunningTime="2026-07-14 02:50:53.925915243 +0000 UTC m=+2974.608486080"
Jul 14 02:50:54.535347 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:54.535302    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-58548_68066f26-c4d5-4b49-8e00-88afb1882a06/global-pull-secret-syncer/0.log"
Jul 14 02:50:54.759999 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:54.759960    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q56rq_a1aa6070-2304-452d-957f-1fe1833526af/konnectivity-agent/0.log"
Jul 14 02:50:54.818208 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:54.818150    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-135.ec2.internal_642dbee9eb2272032636e1b0ef1491d1/haproxy/0.log"
Jul 14 02:50:59.038907 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:59.038877    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb_90ace907-c5e9-4596-917d-a5d4a546ad21/extract/0.log"
Jul 14 02:50:59.060502 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:59.060420    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb_90ace907-c5e9-4596-917d-a5d4a546ad21/util/0.log"
Jul 14 02:50:59.077788 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:59.077754    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qglqb_90ace907-c5e9-4596-917d-a5d4a546ad21/pull/0.log"
Jul 14 02:50:59.100130 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:59.100098    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc_fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92/extract/0.log"
Jul 14 02:50:59.121920 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:59.121870    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc_fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92/util/0.log"
Jul 14 02:50:59.142422 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:59.142379    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rqdcc_fbe30c9f-bd1e-4d59-9fd8-36bfb13c3f92/pull/0.log"
Jul 14 02:50:59.175768 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:59.175698    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88_729913af-5015-4678-abb1-15b74734d779/extract/0.log"
Jul 14 02:50:59.198770 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:59.198742    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88_729913af-5015-4678-abb1-15b74734d779/util/0.log"
Jul 14 02:50:59.218310 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:59.218253    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73v8c88_729913af-5015-4678-abb1-15b74734d779/pull/0.log"
Jul 14 02:50:59.253992 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:59.253964    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s_392f2074-5af1-4066-be7d-87f972017981/extract/0.log"
Jul 14 02:50:59.271369 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:59.271326    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s_392f2074-5af1-4066-be7d-87f972017981/util/0.log"
Jul 14 02:50:59.290546 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:59.290462    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mrh9s_392f2074-5af1-4066-be7d-87f972017981/pull/0.log"
Jul 14 02:50:59.743637 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:59.743594    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-ffb6789c8-wr5qt_01b26d5e-265a-4ce1-aaea-d27c20121657/authorino/0.log"
Jul 14 02:50:59.815971 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:50:59.815898    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9l57d_2aa3164b-a1fb-4963-880a-c136f37c7850/kuadrant-console-plugin/0.log"
Jul 14 02:51:00.016795 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:00.016709    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-cn79h_ad70e053-7228-4854-9303-bd9be426197a/limitador/0.log"
Jul 14 02:51:01.728924 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:01.728876    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fdee9bc-1efb-4c08-9429-c50ce2c16222/alertmanager/0.log"
Jul 14 02:51:01.749307 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:01.749281    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fdee9bc-1efb-4c08-9429-c50ce2c16222/config-reloader/0.log"
Jul 14 02:51:01.770036 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:01.769966    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fdee9bc-1efb-4c08-9429-c50ce2c16222/kube-rbac-proxy-web/0.log"
Jul 14 02:51:01.788995 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:01.787557    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fdee9bc-1efb-4c08-9429-c50ce2c16222/kube-rbac-proxy/0.log"
Jul 14 02:51:01.808429 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:01.808377    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fdee9bc-1efb-4c08-9429-c50ce2c16222/kube-rbac-proxy-metric/0.log"
Jul 14 02:51:01.826767 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:01.826736    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fdee9bc-1efb-4c08-9429-c50ce2c16222/prom-label-proxy/0.log"
Jul 14 02:51:01.846795 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:01.846767    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fdee9bc-1efb-4c08-9429-c50ce2c16222/init-config-reloader/0.log"
Jul 14 02:51:01.886721 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:01.886683    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-pgm8g_6f76e208-03bc-4869-ab22-47543479a78e/cluster-monitoring-operator/0.log"
Jul 14 02:51:01.973956 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:01.973928    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7456cb6c-fvlrl_4a4ef38e-4c51-45f7-8be5-355023a1cd37/metrics-server/0.log"
Jul 14 02:51:02.000852 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.000740    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-scqqd_8b8e2777-8105-44e4-b746-d8c53bc11efc/monitoring-plugin/0.log"
Jul 14 02:51:02.096358 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.096313    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b75jn_f7d1665c-708b-476b-bc13-3a3e0b6ecb8c/node-exporter/0.log"
Jul 14 02:51:02.113154 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.113102    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b75jn_f7d1665c-708b-476b-bc13-3a3e0b6ecb8c/kube-rbac-proxy/0.log"
Jul 14 02:51:02.130592 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.130548    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b75jn_f7d1665c-708b-476b-bc13-3a3e0b6ecb8c/init-textfile/0.log"
Jul 14 02:51:02.228398 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.228369    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-lqpqr_7214052c-b032-4421-ae2f-64709c76546b/kube-rbac-proxy-main/0.log"
Jul 14 02:51:02.250440 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.250411    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-lqpqr_7214052c-b032-4421-ae2f-64709c76546b/kube-rbac-proxy-self/0.log"
Jul 14 02:51:02.267598 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.267510    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-lqpqr_7214052c-b032-4421-ae2f-64709c76546b/openshift-state-metrics/0.log"
Jul 14 02:51:02.449554 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.449521    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-r7dsg_9b297e6f-b3a6-499c-bd7e-81c033ed2471/prometheus-operator/0.log"
Jul 14 02:51:02.466280 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.466246    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-r7dsg_9b297e6f-b3a6-499c-bd7e-81c033ed2471/kube-rbac-proxy/0.log"
Jul 14 02:51:02.536411 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.536328    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fd4594bdf-5dhqs_4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7/telemeter-client/0.log"
Jul 14 02:51:02.561401 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.561367    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fd4594bdf-5dhqs_4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7/reload/0.log"
Jul 14 02:51:02.577625 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.577578    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fd4594bdf-5dhqs_4f3ed24d-94f9-4fd5-9bc0-13a98d3e54a7/kube-rbac-proxy/0.log"
Jul 14 02:51:02.616044 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.616017    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f95cccbb6-8gntx_342ddfbe-e3ea-4848-a01b-cfbc26140362/thanos-query/0.log"
Jul 14 02:51:02.634582 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.634556    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f95cccbb6-8gntx_342ddfbe-e3ea-4848-a01b-cfbc26140362/kube-rbac-proxy-web/0.log"
Jul 14 02:51:02.652890 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.652855    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f95cccbb6-8gntx_342ddfbe-e3ea-4848-a01b-cfbc26140362/kube-rbac-proxy/0.log"
Jul 14 02:51:02.676559 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.676504    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f95cccbb6-8gntx_342ddfbe-e3ea-4848-a01b-cfbc26140362/prom-label-proxy/0.log"
Jul 14 02:51:02.692654 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.692623    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f95cccbb6-8gntx_342ddfbe-e3ea-4848-a01b-cfbc26140362/kube-rbac-proxy-rules/0.log"
Jul 14 02:51:02.712091 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:02.712051    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f95cccbb6-8gntx_342ddfbe-e3ea-4848-a01b-cfbc26140362/kube-rbac-proxy-metrics/0.log"
Jul 14 02:51:04.127543 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:04.127512    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-8wjdc_2284c8c8-e8b2-4a53-8fc3-208d1e0e9561/networking-console-plugin/0.log"
Jul 14 02:51:04.753872 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:04.753846    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:51:04.760102 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:04.760073    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/3.log"
Jul 14 02:51:05.310810 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:05.310767    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c6cb7fbd5-mqq2n_e942b737-83b0-485e-9b59-dff983aa615e/console/0.log"
Jul 14 02:51:05.962758 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:05.962728    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-s6tpf_cae3f82a-8916-4f1f-a48c-ef3d3d477b65/volume-data-source-validator/0.log"
Jul 14 02:51:06.022480 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.022438    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"]
Jul 14 02:51:06.031719 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.031683    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.034553 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.034504    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"]
Jul 14 02:51:06.035077 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.034993    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-btqq2\"/\"default-dockercfg-9lvvj\""
Jul 14 02:51:06.139446 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.139400    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ab72dd2-7f41-4c79-bcf9-49253ebaa432-lib-modules\") pod \"perf-node-gather-daemonset-2chsp\" (UID: \"6ab72dd2-7f41-4c79-bcf9-49253ebaa432\") " pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.139657 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.139482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ab72dd2-7f41-4c79-bcf9-49253ebaa432-sys\") pod \"perf-node-gather-daemonset-2chsp\" (UID: \"6ab72dd2-7f41-4c79-bcf9-49253ebaa432\") " pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.139657 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.139533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p6s4\" (UniqueName: \"kubernetes.io/projected/6ab72dd2-7f41-4c79-bcf9-49253ebaa432-kube-api-access-4p6s4\") pod \"perf-node-gather-daemonset-2chsp\" (UID: \"6ab72dd2-7f41-4c79-bcf9-49253ebaa432\") " pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.139753 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.139669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6ab72dd2-7f41-4c79-bcf9-49253ebaa432-podres\") pod \"perf-node-gather-daemonset-2chsp\" (UID: \"6ab72dd2-7f41-4c79-bcf9-49253ebaa432\") " pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.139753 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.139694    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6ab72dd2-7f41-4c79-bcf9-49253ebaa432-proc\") pod \"perf-node-gather-daemonset-2chsp\" (UID: \"6ab72dd2-7f41-4c79-bcf9-49253ebaa432\") " pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.240914 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.240812    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6ab72dd2-7f41-4c79-bcf9-49253ebaa432-podres\") pod \"perf-node-gather-daemonset-2chsp\" (UID: \"6ab72dd2-7f41-4c79-bcf9-49253ebaa432\") " pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.240914 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.240871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6ab72dd2-7f41-4c79-bcf9-49253ebaa432-proc\") pod \"perf-node-gather-daemonset-2chsp\" (UID: \"6ab72dd2-7f41-4c79-bcf9-49253ebaa432\") " pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.241207 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.240926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ab72dd2-7f41-4c79-bcf9-49253ebaa432-lib-modules\") pod \"perf-node-gather-daemonset-2chsp\" (UID: \"6ab72dd2-7f41-4c79-bcf9-49253ebaa432\") " pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.241207 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.240962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ab72dd2-7f41-4c79-bcf9-49253ebaa432-sys\") pod \"perf-node-gather-daemonset-2chsp\" (UID: \"6ab72dd2-7f41-4c79-bcf9-49253ebaa432\") " pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.241207 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.240993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6ab72dd2-7f41-4c79-bcf9-49253ebaa432-podres\") pod \"perf-node-gather-daemonset-2chsp\" (UID: \"6ab72dd2-7f41-4c79-bcf9-49253ebaa432\") " pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.241207 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.240998    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6ab72dd2-7f41-4c79-bcf9-49253ebaa432-proc\") pod \"perf-node-gather-daemonset-2chsp\" (UID: \"6ab72dd2-7f41-4c79-bcf9-49253ebaa432\") " pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.241207 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.241003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p6s4\" (UniqueName: \"kubernetes.io/projected/6ab72dd2-7f41-4c79-bcf9-49253ebaa432-kube-api-access-4p6s4\") pod \"perf-node-gather-daemonset-2chsp\" (UID: \"6ab72dd2-7f41-4c79-bcf9-49253ebaa432\") " pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.241207 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.241063    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ab72dd2-7f41-4c79-bcf9-49253ebaa432-sys\") pod \"perf-node-gather-daemonset-2chsp\" (UID: \"6ab72dd2-7f41-4c79-bcf9-49253ebaa432\") " pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.241207 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.241093    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ab72dd2-7f41-4c79-bcf9-49253ebaa432-lib-modules\") pod \"perf-node-gather-daemonset-2chsp\" (UID: \"6ab72dd2-7f41-4c79-bcf9-49253ebaa432\") " pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.249937 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.249392    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p6s4\" (UniqueName: \"kubernetes.io/projected/6ab72dd2-7f41-4c79-bcf9-49253ebaa432-kube-api-access-4p6s4\") pod \"perf-node-gather-daemonset-2chsp\" (UID: \"6ab72dd2-7f41-4c79-bcf9-49253ebaa432\") " pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.347645 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.347602    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:06.534827 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:06.534713    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"]
Jul 14 02:51:06.539867 ip-10-0-129-135 kubenswrapper[2563]: W0714 02:51:06.539831    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6ab72dd2_7f41_4c79_bcf9_49253ebaa432.slice/crio-063c2adcacc872921b1a76466b0a0086f507d5d5c2086e726afa61d3e895672a WatchSource:0}: Error finding container 063c2adcacc872921b1a76466b0a0086f507d5d5c2086e726afa61d3e895672a: Status 404 returned error can't find the container with id 063c2adcacc872921b1a76466b0a0086f507d5d5c2086e726afa61d3e895672a
Jul 14 02:51:07.039538 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:07.039494    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp" event={"ID":"6ab72dd2-7f41-4c79-bcf9-49253ebaa432","Type":"ContainerStarted","Data":"89a6df98c9af524f6361ed5351f308acc8d4693ef7f51a16d071e26cae1bffaa"}
Jul 14 02:51:07.039718 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:07.039567    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:07.039718 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:07.039590    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp" event={"ID":"6ab72dd2-7f41-4c79-bcf9-49253ebaa432","Type":"ContainerStarted","Data":"063c2adcacc872921b1a76466b0a0086f507d5d5c2086e726afa61d3e895672a"}
Jul 14 02:51:07.053539 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:07.053454    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp" podStartSLOduration=1.053435549 podStartE2EDuration="1.053435549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 02:51:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 02:51:07.052944892 +0000 UTC m=+2987.735515776" watchObservedRunningTime="2026-07-14 02:51:07.053435549 +0000 UTC m=+2987.736006386"
Jul 14 02:51:07.063544 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:07.063515    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qm78c_c7dd9ccd-d174-4a35-a879-ad714f1d0c18/dns/0.log"
Jul 14 02:51:07.079622 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:07.079596    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qm78c_c7dd9ccd-d174-4a35-a879-ad714f1d0c18/kube-rbac-proxy/0.log"
Jul 14 02:51:07.139494 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:07.139466    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tqxqv_08411450-7e59-47d7-86fd-a9df899dc964/dns-node-resolver/0.log"
Jul 14 02:51:07.670317 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:07.670277    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7ftxk_db745a62-430b-4b46-906f-761da9b8cdbe/node-ca/0.log"
Jul 14 02:51:08.707005 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:08.706976    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69dd74468c-7mnrs_1f3942ae-267c-40d9-96ea-171903468426/kube-auth-proxy/0.log"
Jul 14 02:51:09.527274 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:09.527239    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sdm9d_08730f0e-7030-486d-9d4b-62e2e12e9080/serve-healthcheck-canary/0.log"
Jul 14 02:51:10.106517 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:10.106488    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lj5bc_4cbbd949-4429-455c-a037-f521796d5270/kube-rbac-proxy/0.log"
Jul 14 02:51:10.123184 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:10.123129    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lj5bc_4cbbd949-4429-455c-a037-f521796d5270/exporter/0.log"
Jul 14 02:51:10.145933 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:10.145901    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lj5bc_4cbbd949-4429-455c-a037-f521796d5270/extractor/0.log"
Jul 14 02:51:12.550280 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:12.550242    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5756559977-m8jzc_36dce243-e020-4321-b331-28b7fadfdf14/manager/0.log"
Jul 14 02:51:12.565965 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:12.565933    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5756559977-m8jzc_36dce243-e020-4321-b331-28b7fadfdf14/copy-manifests/0.log"
Jul 14 02:51:13.065036 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:13.065010    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-btqq2/perf-node-gather-daemonset-2chsp"
Jul 14 02:51:13.763720 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:13.763685    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7cbf965c66-mqkzf_4cee436a-ba57-4bee-b215-b2e17e5caf2e/manager/0.log"
Jul 14 02:51:16.133720 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:16.133683    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69dd74468c-7mnrs_1f3942ae-267c-40d9-96ea-171903468426/kube-auth-proxy/0.log"
Jul 14 02:51:17.649325 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:17.649236    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-69dd74468c-7mnrs_1f3942ae-267c-40d9-96ea-171903468426/kube-auth-proxy/0.log"
Jul 14 02:51:18.974644 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:18.974602    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-zmk4h_4fb27c74-7a83-49cd-9a76-1bd067147060/migrator/0.log"
Jul 14 02:51:18.991927 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:18.991897    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-zmk4h_4fb27c74-7a83-49cd-9a76-1bd067147060/graceful-termination/0.log"
Jul 14 02:51:20.291669 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.291634    2563 scope.go:117] "RemoveContainer" containerID="e85a71330e32a63215f1cea4be2feb685963aa8764829d6dba707576d55792db"
Jul 14 02:51:20.301434 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.301411    2563 scope.go:117] "RemoveContainer" containerID="954062ac58ea2345cbc5632cf735455863238687e196081edb0374e70b4cc125"
Jul 14 02:51:20.318461 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.318432    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ffrf7_2ca207ce-6644-4908-b414-240bccf75bd0/kube-multus-additional-cni-plugins/0.log"
Jul 14 02:51:20.333967 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.333944    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ffrf7_2ca207ce-6644-4908-b414-240bccf75bd0/egress-router-binary-copy/0.log"
Jul 14 02:51:20.350794 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.350769    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ffrf7_2ca207ce-6644-4908-b414-240bccf75bd0/cni-plugins/0.log"
Jul 14 02:51:20.366116 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.366088    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ffrf7_2ca207ce-6644-4908-b414-240bccf75bd0/bond-cni-plugin/0.log"
Jul 14 02:51:20.381153 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.381126    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ffrf7_2ca207ce-6644-4908-b414-240bccf75bd0/routeoverride-cni/0.log"
Jul 14 02:51:20.395774 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.395750    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ffrf7_2ca207ce-6644-4908-b414-240bccf75bd0/whereabouts-cni-bincopy/0.log"
Jul 14 02:51:20.410944 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.410917    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ffrf7_2ca207ce-6644-4908-b414-240bccf75bd0/whereabouts-cni/0.log"
Jul 14 02:51:20.685553 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.685513    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-d2vht_08a91a1c-3798-4615-86e2-e4213dac2b59/kube-multus/0.log"
Jul 14 02:51:20.827117 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.827079    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wnrxm_cf6bc5ea-e0e1-415d-b47a-19bc897a699c/network-metrics-daemon/0.log"
Jul 14 02:51:20.844732 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.844707    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wnrxm_cf6bc5ea-e0e1-415d-b47a-19bc897a699c/kube-rbac-proxy/0.log"
Jul 14 02:51:20.966491 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.966352    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:51:20.970282 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.970257    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:51:20.977380 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.977352    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-gwlst_c77e9abc-8454-4bb3-a76e-44313a61006e/console-operator/2.log"
Jul 14 02:51:20.980866 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:20.980844    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:51:21.838532 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:21.838467    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-controller/0.log"
Jul 14 02:51:21.855204 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:21.855149    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/0.log"
Jul 14 02:51:21.855204 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:21.855188    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovn-acl-logging/1.log"
Jul 14 02:51:21.870468 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:21.870443    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/kube-rbac-proxy-node/0.log"
Jul 14 02:51:21.903959 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:21.903927    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/kube-rbac-proxy-ovn-metrics/0.log"
Jul 14 02:51:21.922574 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:21.922544    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/northd/0.log"
Jul 14 02:51:21.938599 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:21.938568    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/nbdb/0.log"
Jul 14 02:51:21.956267 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:21.956229    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/sbdb/0.log"
Jul 14 02:51:22.016014 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:22.015984    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l4xnb_a53a3ae2-0828-49a1-b4dd-e352caae8834/ovnkube-controller/0.log"
Jul 14 02:51:23.244668 ip-10-0-129-135 kubenswrapper[2563]: I0714 02:51:23.244637    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-kwm2d_73be1377-1b11-4b2f-b6bf-f27e04d7f3df/network-check-target-container/0.log"